-- Logs begin at Mon 2022-08-01 13:17:59 UTC, end at Mon 2022-08-01 14:39:59 UTC. -- Aug 01 14:10:41.064822 dv-cinder-845990-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 01 14:10:41.073858 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 01 14:10:41.075889 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 14:10:41 2022] *** Aug 01 14:10:41.075889 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 14:10:41.075889 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 14:10:41.075889 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: nodename: dv-cinder-845990-5-iscsi Aug 01 14:10:41.075889 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: machine: x86_64 Aug 01 14:10:41.075889 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: clock source: unix Aug 01 14:10:41.075889 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: pcre jit disabled Aug 01 14:10:41.075889 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: detected number of CPU cores: 4 Aug 01 14:10:41.075889 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: current working directory: / Aug 01 14:10:41.075889 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: detected binary path: /usr/bin/uwsgi-core Aug 01 14:10:41.076679 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: your processes number limit is 47680 Aug 01 14:10:41.076679 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: your memory page size is 4096 bytes Aug 01 14:10:41.076679 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: detected max file descriptor number: 2048 Aug 01 14:10:41.076679 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: lock engine: pthread robust mutexes Aug 01 14:10:41.076679 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: thunder lock: enabled Aug 01 14:10:41.076679 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 01 14:10:41.076679 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 14:10:41.116280 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: Python main interpreter initialized at 0x562fa6eb69c0 Aug 01 14:10:41.116280 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: python threads support enabled Aug 01 14:10:41.116280 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: your server socket listen backlog is limited to 100 connections Aug 01 14:10:41.116280 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: your mercy for graceful operations on workers is 90 seconds Aug 01 14:10:41.116718 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 14:10:41.116718 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: *** Operational MODE: preforking *** Aug 01 14:10:41.116996 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: *** uWSGI is running in multiple interpreter mode *** Aug 01 14:10:41.116996 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: spawned uWSGI master process (pid: 103535) Aug 01 14:10:41.117212 dv-cinder-845990-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 01 14:10:41.118602 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: spawned uWSGI worker 1 (pid: 103536, cores: 1) Aug 01 14:10:41.118602 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: spawned uWSGI worker 2 (pid: 103537, cores: 1) Aug 01 14:10:41.118602 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 14:10:41.792544 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 14:10:41.797492 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 14:10:42.900031 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:10:42.900031 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: from cryptography.utils import int_from_bytes Aug 01 14:10:42.900810 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:10:42.900810 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: from cryptography.utils import int_from_bytes Aug 01 14:10:42.900948 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:10:42.900948 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: from cryptography.utils import int_from_bytes Aug 01 14:10:42.901337 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:10:42.901337 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: from cryptography.utils import int_from_bytes Aug 01 14:10:45.468463 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 14:10:45.469147 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 14:10:45.469262 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 14:10:45.469634 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 14:10:45.469893 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 14:10:45.470246 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 14:10:45.471151 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.471541 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 14:10:45.471632 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.471713 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.471887 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 14:10:45.472027 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.472253 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 14:10:45.472359 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.472509 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 14:10:45.472718 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.472904 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.473012 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.473226 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.473330 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.473543 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.473646 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.473855 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.473955 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.474170 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.474265 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.474477 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.474607 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845990-5-iscsi {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.474795 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.474931 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.475102 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.475229 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.475416 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.475573 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.475711 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.475846 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.475997 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.476133 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.476316 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845990-5-iscsi {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.476445 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.476634 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.476764 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.476939 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.477133 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.477282 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.478436 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.478654 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.478837 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.478995 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.479207 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.479361 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.479602 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.479781 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.479781 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.480100 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.480321 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.480525 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.480677 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.480855 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.481071 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.481250 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.481414 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.481631 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.481781 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.481988 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.481988 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.482314 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845990-5-iscsi {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.482494 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.482703 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.482894 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.483044 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.483044 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.483381 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.483381 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.483684 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.483818 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845990-5-iscsi {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.483975 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.484100 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.484311 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.484458 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.484597 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.484750 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.484875 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.484875 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.485124 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.485264 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.485388 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.485511 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.485650 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.485774 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.485898 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.486060 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.486187 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.486947 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.487081 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.487214 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.487356 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.487517 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.487645 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.487768 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.487891 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.488029 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.488169 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.488295 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.488418 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.488541 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.488700 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.488863 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.489000 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.489132 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.489258 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.489381 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.489503 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.489649 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.489800 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.489932 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.490065 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.490189 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.490320 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.490462 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.490589 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.490713 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.490850 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.490981 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.491106 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.491106 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.491352 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.491501 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.491628 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.491768 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.491983 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.492123 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.492260 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.492395 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.492519 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.492649 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.492786 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.492923 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.493031 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.493153 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.493292 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.493425 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.493604 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.493736 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.493861 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.493983 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.494104 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.494234 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.494446 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.494577 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.494708 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.494832 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.494964 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.495098 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.495212 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.495334 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.495477 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.495603 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.495738 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.495877 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.496012 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.496140 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.496263 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.496386 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.496521 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.496646 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.496768 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.496898 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.497024 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.497146 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.497278 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.497403 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.497532 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.497662 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.497784 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.497906 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.498037 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.498162 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.498284 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.498407 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.498537 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.498704 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.498844 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.498968 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.499122 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.499259 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.499431 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.499633 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.499768 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.499894 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.500054 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.500181 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.500354 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.500489 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.500655 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.500782 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.500959 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.501094 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.501261 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.501402 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.501562 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.501689 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.501865 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.502107 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.502232 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.502366 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.502490 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.502613 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.502775 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.502910 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.503078 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.503211 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.503376 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.503534 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.503704 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.503832 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.504031 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.504166 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.504337 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.504480 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.504688 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.504817 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.505085 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.505230 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.505417 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.505670 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.505791 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.506100 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.506237 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.506409 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.506738 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.506873 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.507034 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.507334 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.507449 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.507683 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.507941 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.508056 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.508279 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.508416 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.508593 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.508765 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.508900 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.509202 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.509322 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.509518 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.509643 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.509830 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.509956 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.510122 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.510264 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.510436 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.510593 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.510739 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.510925 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.511047 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.511246 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.511359 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.511591 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.511721 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.511908 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.512022 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.512279 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.512422 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.512721 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.512845 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.512954 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.513089 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.513215 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.513355 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.513481 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.513618 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.513752 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.513879 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.514009 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.514147 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.514273 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.514396 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.514563 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.514708 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.514939 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.515078 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.515203 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.515326 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.515537 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.515669 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:10:45.515880 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.516013 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.516197 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.516326 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.516528 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.516659 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.516857 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.517001 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.517173 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.517309 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.517480 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.517616 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.517817 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.517947 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.518139 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.518268 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.518447 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.518658 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.518786 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.518910 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.519035 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.519158 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.519351 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.519557 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.519693 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.519818 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.519997 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.520154 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.520290 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.520421 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.520603 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.520742 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.520920 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.521047 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.521208 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.521348 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.521519 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.521648 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.521842 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.521972 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.522162 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.522301 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.522473 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.522601 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.522811 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.522940 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.523137 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.523275 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.523449 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.523607 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.523797 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.523925 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.524120 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.524258 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.524430 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.524559 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.524737 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.524866 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.525083 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.525212 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.525346 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.525473 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.525665 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.525801 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.525973 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.526112 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.526287 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.526417 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.526596 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.526725 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.526904 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.527035 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.527212 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.527341 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.527534 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.527664 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.527838 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.527969 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.528249 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.528399 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.528531 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.528673 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.528799 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.528921 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.529046 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.529169 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.529364 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.529492 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.529671 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.529786 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.530016 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.530144 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.530283 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.530408 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.530586 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.530702 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.530887 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.531001 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.531187 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.531314 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.531510 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.531643 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.531814 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.531943 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.532128 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.532266 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.532465 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.532604 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.532749 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.532874 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.533076 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.533720 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.534045 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.534180 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.534403 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.534539 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.534782 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.534912 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.535134 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.535414 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.535590 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.535758 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.535959 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.536089 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.536372 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.536499 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.536684 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.536977 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.537121 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.537310 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.537485 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.537613 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.537916 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.538053 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.538249 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.538557 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.538683 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.538864 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.539086 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.539223 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.539501 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.539678 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.539819 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.540118 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.540251 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.540430 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.540710 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.540846 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.541053 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.541229 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.541366 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.541688 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.541815 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.542019 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.542260 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.542397 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.542638 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.542827 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.542956 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.543268 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.543396 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.543593 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.543904 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.544034 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.544211 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.544497 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.544639 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.544810 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.545063 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.545207 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.545407 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.545648 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.545785 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.545988 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.546242 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.546364 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.546586 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.546763 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.546892 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.547211 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.547366 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.547539 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.547847 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.547975 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.548153 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.548471 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.548602 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.548855 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.549563 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.549727 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.550066 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.550243 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.550379 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.550624 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.550836 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.550967 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.551239 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.551371 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.551536 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.551674 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.551801 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.551925 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.552065 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.552253 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.552381 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.552515 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.552650 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.552826 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.552969 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.553136 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.553271 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.553458 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.553587 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.553771 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.553910 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.554078 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.554204 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.554387 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.554515 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.554696 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.554835 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.555000 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.555127 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.555319 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.555572 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.555715 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.555844 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.556009 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.556138 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.556327 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.556455 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.556652 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.556781 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.556967 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.557102 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.557283 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.557409 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.557591 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.557726 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.557903 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.558032 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.558212 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.558338 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.558521 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.558650 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.558839 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.558966 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.559149 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.559285 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.559481 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.559610 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.559796 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.559925 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.560118 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.560286 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.560423 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.560547 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.560773 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.560914 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.561041 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.561158 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.561335 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.561600 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.561791 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.561987 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.562106 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.562367 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.562478 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.562584 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.562698 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.562805 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.562922 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.563038 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.563185 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.563300 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.563520 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.563638 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.563832 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.563949 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.564138 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.564260 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.564473 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.564586 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.564791 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.564914 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.565100 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.565216 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.565410 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.565523 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.565752 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.565863 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.566065 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.566194 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.566325 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.566437 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.566635 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.566757 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.566934 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.567046 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.567238 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.567366 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.567577 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.567694 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.567909 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.568023 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.568219 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.568349 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.568529 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.568651 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.568849 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.568963 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.569412 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.569791 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.569906 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.570047 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.570183 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.570315 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.570451 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.570590 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.570725 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.570851 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.570976 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.571099 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.571233 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.571359 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.571511 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.571639 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.571779 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.571914 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.572049 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.572175 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.572300 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.572432 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.572559 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.572683 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.572816 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.572949 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.573074 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.573205 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.573330 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.573454 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.573589 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.573714 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.573890 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.574041 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.574212 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.574420 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.574548 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.574673 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.574822 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.574951 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.575190 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.575352 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.575521 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.575664 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.575899 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.576028 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.576153 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.576286 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.576429 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.576556 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.576687 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.576820 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.576956 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.577092 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.577253 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.577383 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.577554 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.577683 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.577869 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.577999 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.578186 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.578492 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.578619 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.578806 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.578932 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.579115 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.579230 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.579420 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.579579 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.579759 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.579900 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.580097 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.580227 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.580405 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.580539 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.580712 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.580855 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.581018 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.581147 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.581322 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.581461 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.581626 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.581755 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.581942 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.582073 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.582246 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.582381 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.582551 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.582680 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.582859 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.582991 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.583159 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.583299 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.583549 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.583697 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.583825 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.583950 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.584146 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.584352 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.584480 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.584680 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.584810 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.584992 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.585130 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.585307 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.585436 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.585622 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.585752 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.585981 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.586116 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.586250 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.586383 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.586555 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.586686 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.586866 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.586995 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.587173 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.587314 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.587495 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.587653 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.587788 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.587913 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.588090 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.588222 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.588400 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.588539 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.588702 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.588833 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.589004 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.589132 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.589306 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.589444 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.589610 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.589738 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.589909 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.590031 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.590209 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.590341 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.590507 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.590636 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.590807 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.590936 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.591117 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.591246 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.591418 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.591592 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.591755 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.591895 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.592057 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.592185 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.592376 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.592506 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.592683 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.592822 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.592989 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.593118 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.593290 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.593417 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.593590 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.593733 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.593900 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.594036 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.594205 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.594342 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.594522 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.594665 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.594833 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.594969 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.595138 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.595275 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.595441 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.595598 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.596570 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.596709 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.596872 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.597011 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.597175 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.597303 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.597479 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.597617 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.597779 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.597908 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.598086 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.598224 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.598392 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.598524 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.598720 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.598853 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.599068 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.599196 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.599321 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.599444 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.599599 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.599737 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.599897 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.600019 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.600196 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.600318 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.600502 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.600640 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.600804 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.600933 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.601115 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.601260 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.601419 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.601561 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.601720 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.601849 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.602020 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.602150 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.602325 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.602463 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.602631 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.602760 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.602931 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.603059 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.603238 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.603368 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.603574 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.603712 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.603868 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.604007 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.604178 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.604309 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.604485 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.604621 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.604784 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.604911 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.605087 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.605216 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.605390 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.605516 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.605691 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.605820 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.605996 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.606135 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.606302 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.606437 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.606606 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.606754 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.606907 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.607031 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.607215 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.607323 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.607534 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.607662 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.607858 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.607986 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.608147 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.608265 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.608462 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.608567 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.608776 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.608864 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.609076 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.609163 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.609385 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.609536 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.609671 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.609797 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.609973 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.610095 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.610366 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.610500 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.610625 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.610748 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.610872 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.610995 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.611133 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.611259 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.612112 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.612420 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.612550 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.612727 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.612873 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.613036 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.613166 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.613361 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.613570 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.613732 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.613890 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.614020 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.614198 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.614327 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.614511 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.614649 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.614815 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.614944 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.615160 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.615290 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.615481 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.615627 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.615818 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.615946 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.616132 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.616269 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.616445 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.616584 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.616806 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.616948 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.617075 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.617206 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.617360 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.617498 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.617669 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.617797 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.617970 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.618097 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.618279 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.618416 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.618584 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.618711 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.618892 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.619027 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.619193 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.619329 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.619519 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.619635 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.619841 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.619954 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.620150 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.620266 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.620456 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.620581 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.620765 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.620879 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.621072 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.621196 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.621384 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.621501 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.621683 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.621798 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.622018 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.622150 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.622294 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.622425 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.622598 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.622739 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.622904 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.623033 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.623211 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.623347 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.623540 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.623689 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.623852 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.623982 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.624160 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.624300 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.624473 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.624610 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.624779 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.624938 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.625075 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.625256 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.625393 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.625571 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.625702 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.625887 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.626017 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.626198 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.626336 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.626507 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.626644 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.626826 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.627077 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.627213 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.627354 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.627541 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.627744 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.627874 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.628005 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.628139 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.628346 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.628481 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.628606 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.628729 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.628853 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.629011 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.629152 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.629354 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.629490 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.629662 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.629790 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.629970 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.630106 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.630283 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.630439 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.630597 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.630757 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.630902 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.631073 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.631298 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.631427 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.631627 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.631809 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.631949 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.632169 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.632300 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.632449 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.632580 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.632771 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.632910 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.633089 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.633218 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.633418 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.633548 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.633750 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.633883 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.634057 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.634185 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.634361 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.634490 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.634672 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.634800 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.634974 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.635100 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.635292 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.635422 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.635647 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.635784 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.635958 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.636088 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.636325 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.636459 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.642992 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.643190 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.643288 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.643363 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.643440 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.643554 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.643554 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.643677 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.643677 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.643814 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.643881 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.643947 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.644019 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.644174 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.644245 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.644312 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.644378 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.644443 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.644443 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.644568 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.644568 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.644688 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.644755 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.644820 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.644894 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.644973 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.644973 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.645100 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.645100 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.645319 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.645395 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.645471 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.645539 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.645605 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.645673 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.645764 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.645843 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.645912 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.645984 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.646051 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.646116 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.646181 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.646255 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.646324 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.646420 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.646543 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.646645 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.646716 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.646793 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.646861 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.646932 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.647027 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.647097 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.647163 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.647427 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.647634 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.647768 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.647839 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.647906 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.648028 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.648254 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.648372 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.648498 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.648628 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.648705 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.648812 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.648892 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.648970 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.649037 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.649183 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.649320 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.649320 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.649457 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.649457 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.649589 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.649795 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.649953 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.649953 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.650135 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.650202 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.650268 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.650333 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.650407 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.650483 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.650551 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.650616 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.650681 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.650746 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.650883 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.650996 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.651071 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.651150 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.651218 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.651290 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.651365 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.651433 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.651535 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.651632 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.651708 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.652592 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.652859 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.652957 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.653063 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.653295 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.653388 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.653466 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.653534 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.653598 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.653663 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.653735 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.653809 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.653883 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.653950 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.654184 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.654270 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.654392 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.654480 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.654973 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.655070 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.655156 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.655238 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.655377 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.655495 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.655674 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.655763 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.655980 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.656068 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.656284 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.656390 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.656704 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.656804 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.656912 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.657005 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.657196 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.657302 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.657497 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.657620 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.657822 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.657913 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.659509 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.659728 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.659893 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.660042 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.660187 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.660330 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.660479 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.661101 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.661179 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.661270 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.661361 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.661453 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.661536 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.661536 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.661683 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.661683 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.661886 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.661978 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.662062 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.662142 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.662270 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.662364 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.662493 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.662587 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.662688 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.662771 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.662860 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.662937 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.663024 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.663323 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.663430 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.663546 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.663659 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.663862 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.663973 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.664169 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.664265 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.664484 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.664564 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.664798 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.664886 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.665111 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.665200 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.665424 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.665519 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.665736 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.665829 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.666052 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.666131 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.666518 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.666633 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.666767 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.667018 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.667159 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.667232 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.667314 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.667809 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.668010 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.668087 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.668164 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.668240 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.668309 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.668532 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.668632 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.668843 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.668933 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.669168 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.669262 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.669464 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.669545 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.669757 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.669890 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.670089 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.670223 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.670430 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.670602 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.670738 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.670872 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.671056 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.671153 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.671371 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.671477 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.671709 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.671837 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.672015 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.672135 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.672325 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.672571 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.672698 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.672998 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.673131 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.673283 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.673600 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.673732 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.673911 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.674662 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.674831 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.674948 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.675054 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.675161 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.675276 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.675410 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.675577 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.675718 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.675832 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.676055 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.676208 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.676400 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.676534 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.676652 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.676759 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.676885 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.677009 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.677187 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.677319 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.677511 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.677642 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.677845 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.677978 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.678164 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.678293 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.678475 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.678602 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.678787 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.678919 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.679098 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.679337 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.679665 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.679810 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.679978 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.680107 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.680309 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.680447 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.680630 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.680767 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.680950 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.681089 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.681257 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.681385 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.681570 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.681697 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.681880 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.682017 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.682191 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.682449 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.682593 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.682881 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.683012 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.683147 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.683394 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.683615 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.683769 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.684032 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.684159 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.684340 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.684576 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.684807 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.684944 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.685162 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.685300 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.685553 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.685722 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.685861 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.686156 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.686285 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.686472 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.686780 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.686916 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.687089 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.687372 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.687567 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.687710 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.688030 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.688338 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.688472 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.688654 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.688952 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.689103 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.689266 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.689417 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.689603 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.689735 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.689918 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.690051 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.690275 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.690405 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.690603 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.690733 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.690915 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.691033 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.691263 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.691600 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.691923 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.692127 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.692272 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.692464 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.692603 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.692788 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.693020 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.693151 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.693284 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.693425 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.693562 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.693735 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.693870 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.694029 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.694161 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.694334 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.694464 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.694662 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.694977 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.695123 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.695281 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.695411 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.695612 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.695742 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.695924 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.696067 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.696229 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.696359 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.696534 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.696670 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.696839 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.696978 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.697144 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.697274 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.697455 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.697584 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.697845 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.697981 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.698159 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.698296 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.698463 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.698590 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.698816 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.699017 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.699220 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.699421 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.699652 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.699868 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.699868 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.700346 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.700552 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.700752 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.700950 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.701157 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.701357 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.701579 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.701785 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.701983 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.702172 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.702353 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.702492 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.702627 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.702760 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.702893 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.703035 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.703264 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.703395 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.703547 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.703676 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.703801 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.703915 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.704031 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.704165 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.704291 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.704423 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.704549 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.704684 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.704684 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.704936 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.705187 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.705328 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.705462 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.705597 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.705732 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.705869 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.705995 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.706123 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.706249 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.706387 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.706513 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.706638 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.706638 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.706888 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.707026 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.707159 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.707285 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.707410 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.707592 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.707727 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.707863 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.707990 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.708114 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.708238 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.708369 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.708494 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.708628 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.708762 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.708890 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.709060 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.709192 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.709375 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.709514 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.709709 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.709839 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.710053 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.710182 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.710363 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.710491 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.710699 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.710826 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.711008 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.711151 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.711316 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.711484 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.711639 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.711769 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.711955 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.712120 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.712310 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.712443 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.712568 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.712700 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.712860 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.713031 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.713160 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.713383 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.713521 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.713637 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.713760 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.713875 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.714040 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.714166 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.714348 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.714478 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.714654 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.714799 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.714964 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.715094 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.715313 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.715450 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.715669 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.715796 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.715920 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.716042 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.716166 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.716290 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.716467 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.716606 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.716772 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.716909 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.717083 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.717213 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.717389 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.717520 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.717707 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.717910 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.718102 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.718233 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.718373 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.718604 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.718744 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.718869 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.719002 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.719139 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.719266 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.719392 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.719642 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.719954 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.720272 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.720581 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.721712 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.722017 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.722330 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.722633 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.722936 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.723239 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.723564 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.723869 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.724171 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.724473 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.724773 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.725076 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.725382 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.725679 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.725988 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.726161 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.726323 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.726575 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.726879 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.727179 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.727530 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.727841 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.728166 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.728478 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.728798 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.729107 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.729247 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.729408 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.729603 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.729737 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.729964 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.730093 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.730310 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.730448 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.730632 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.730760 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.730941 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.731076 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.731273 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.731411 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.731619 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.731937 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.732176 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.732308 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.732534 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.732692 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.732829 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.732957 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.733142 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.733272 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.733468 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.733791 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.733925 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.734042 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.734168 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.734294 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.734411 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.734537 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.734693 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.734809 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.735014 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.735143 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.735504 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.735632 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.735867 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.736005 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.736134 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.736278 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.736969 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.737099 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.737225 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.737349 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.737497 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.737636 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.737807 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.737944 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.738116 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.738248 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.738428 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.738566 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.738735 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.738865 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.739042 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.739171 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.739354 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.739544 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.739683 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.739810 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.740001 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.740131 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.740322 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.740462 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.740629 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.740768 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.740952 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.741087 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.741274 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.741405 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.741620 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.741750 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.741930 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.742059 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.742273 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.742405 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.742601 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.742739 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.742915 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.743053 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.743226 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.743354 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.743553 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.743698 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.743905 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 14:10:45.744048 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.744256 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.744577 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.744892 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:10:45.745143 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 14:10:45.899874 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO dbcounter [None req-280de51f-49b3-4763-9bf5-eb75476e1085 None None] Registered counter for database nova_api Aug 01 14:10:45.900412 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO dbcounter [None req-90da747c-df71-4f44-886c-6dc4cb30582d None None] Registered counter for database nova_api Aug 01 14:10:45.922788 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG oslo_db.sqlalchemy.engines [None req-280de51f-49b3-4763-9bf5-eb75476e1085 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:10:45.924747 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG oslo_db.sqlalchemy.engines [None req-90da747c-df71-4f44-886c-6dc4cb30582d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:10:45.930424 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writer thread running {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:10:45.931913 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG dbcounter [-] [103536] Writer thread running {{(pid=103536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:10:45.989519 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.context [None req-280de51f-49b3-4763-9bf5-eb75476e1085 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9805e85f-ba25-403f-8805-6e956776eddb(cell1) {{(pid=103537) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 14:10:45.989989 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.context [None req-90da747c-df71-4f44-886c-6dc4cb30582d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9805e85f-ba25-403f-8805-6e956776eddb(cell1) {{(pid=103536) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 14:10:45.993552 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-280de51f-49b3-4763-9bf5-eb75476e1085 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:45.994007 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG oslo_concurrency.lockutils [None req-90da747c-df71-4f44-886c-6dc4cb30582d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:45.995180 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-280de51f-49b3-4763-9bf5-eb75476e1085 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:45.996038 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-280de51f-49b3-4763-9bf5-eb75476e1085 None None] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:45.996404 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG oslo_concurrency.lockutils [None req-90da747c-df71-4f44-886c-6dc4cb30582d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:45.997594 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG oslo_concurrency.lockutils [None req-90da747c-df71-4f44-886c-6dc4cb30582d None None] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:45.998091 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-280de51f-49b3-4763-9bf5-eb75476e1085 None None] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:45.999726 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG oslo_concurrency.lockutils [None req-90da747c-df71-4f44-886c-6dc4cb30582d None None] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:46.000206 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO dbcounter [None req-280de51f-49b3-4763-9bf5-eb75476e1085 None None] Registered counter for database nova_cell0 Aug 01 14:10:46.001778 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO dbcounter [None req-90da747c-df71-4f44-886c-6dc4cb30582d None None] Registered counter for database nova_cell0 Aug 01 14:10:46.006218 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO dbcounter [None req-280de51f-49b3-4763-9bf5-eb75476e1085 None None] Registered counter for database nova_cell1 Aug 01 14:10:46.007828 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO dbcounter [None req-90da747c-df71-4f44-886c-6dc4cb30582d None None] Registered counter for database nova_cell1 Aug 01 14:10:46.015442 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG oslo_db.sqlalchemy.engines [None req-280de51f-49b3-4763-9bf5-eb75476e1085 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:10:46.016711 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG oslo_db.sqlalchemy.engines [None req-280de51f-49b3-4763-9bf5-eb75476e1085 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:10:46.020103 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG oslo_db.sqlalchemy.engines [None req-90da747c-df71-4f44-886c-6dc4cb30582d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:10:46.023537 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writer thread running {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:10:46.025217 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG dbcounter [-] [103536] Writer thread running {{(pid=103536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:10:46.029282 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writer thread running {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:10:46.030611 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG oslo_db.sqlalchemy.engines [None req-90da747c-df71-4f44-886c-6dc4cb30582d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:10:46.177255 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG dbcounter [-] [103536] Writer thread running {{(pid=103536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:10:46.180931 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO dbcounter [None req-280de51f-49b3-4763-9bf5-eb75476e1085 None None] Registered counter for database nova_cell0 Aug 01 14:10:46.186591 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO dbcounter [None req-90da747c-df71-4f44-886c-6dc4cb30582d None None] Registered counter for database nova_cell0 Aug 01 14:10:46.191823 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG oslo_db.sqlalchemy.engines [None req-280de51f-49b3-4763-9bf5-eb75476e1085 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:10:46.195774 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG oslo_db.sqlalchemy.engines [None req-90da747c-df71-4f44-886c-6dc4cb30582d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:10:46.196811 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writer thread running {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:10:46.200782 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG dbcounter [-] [103536] Writer thread running {{(pid=103536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:10:46.541114 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: WARNING keystonemiddleware.auth_token [None req-90da747c-df71-4f44-886c-6dc4cb30582d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 14:10:46.544102 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: WARNING keystonemiddleware.auth_token [None req-280de51f-49b3-4763-9bf5-eb75476e1085 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 14:10:46.548593 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: WARNING keystonemiddleware.auth_token [None req-90da747c-df71-4f44-886c-6dc4cb30582d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 14:10:46.551617 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: WARNING keystonemiddleware.auth_token [None req-280de51f-49b3-4763-9bf5-eb75476e1085 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 14:10:46.904950 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: WARNING keystonemiddleware.auth_token [None req-90da747c-df71-4f44-886c-6dc4cb30582d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 14:10:46.911531 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: WARNING keystonemiddleware.auth_token [None req-90da747c-df71-4f44-886c-6dc4cb30582d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 14:10:46.913675 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: WARNING keystonemiddleware.auth_token [None req-280de51f-49b3-4763-9bf5-eb75476e1085 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 14:10:46.916809 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562fa6eb69c0 pid: 103536 (default app) Aug 01 14:10:46.918945 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-90da747c-df71-4f44-886c-6dc4cb30582d None None] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:46.919824 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: WARNING keystonemiddleware.auth_token [None req-280de51f-49b3-4763-9bf5-eb75476e1085 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 14:10:46.920148 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-90da747c-df71-4f44-886c-6dc4cb30582d None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001802 Aug 01 14:10:46.920540 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Mon Aug 1 14:10:46 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:10:46.925294 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562fa6eb69c0 pid: 103537 (default app) Aug 01 14:12:15.752632 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-90da747c-df71-4f44-886c-6dc4cb30582d None None] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:15.753662 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-90da747c-df71-4f44-886c-6dc4cb30582d None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 01 14:12:15.754064 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 2/2] 10.222.0.17 () {54 vars in 930 bytes} [Mon Aug 1 14:12:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:15.768262 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writing DB stats nova_api:SELECT=3 {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:15.769563 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writing DB stats nova_cell0:SELECT=3 {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:15.770453 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writing DB stats nova_cell1:SELECT=3 {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:15.774375 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:17.361167 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-97a14d15-f211-4666-b1bf-173736eda409 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:17.420565 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-97a14d15-f211-4666-b1bf-173736eda409 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.658706 Aug 01 14:12:17.423085 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 1/3] 10.222.0.17 () {60 vars in 1291 bytes} [Mon Aug 1 14:12:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:12:20.528461 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-90da747c-df71-4f44-886c-6dc4cb30582d None None] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:20.530700 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-90da747c-df71-4f44-886c-6dc4cb30582d None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002799 Aug 01 14:12:20.533567 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 3/4] 10.222.0.17 () {54 vars in 930 bytes} [Mon Aug 1 14:12:20 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:21.454019 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-d44eab35-a191-43bd-a04d-1f79be8ba09d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "vcpus": 1, "name": "cirros256", "disk": 1, "ram": 256, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:21.477635 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:12:21.477635 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: warnings.warn(msg) Aug 01 14:12:21.542674 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-d44eab35-a191-43bd-a04d-1f79be8ba09d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.994089 Aug 01 14:12:21.546598 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 2/5] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Aug 1 14:12:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:12:21.573766 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG dbcounter [-] [103536] Writing DB stats nova_api:SELECT=3 {{(pid=103536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:21.576147 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG dbcounter [-] [103536] Writing DB stats nova_cell0:SELECT=3 {{(pid=103536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:21.578228 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG dbcounter [-] [103536] Writing DB stats nova_cell1:SELECT=3 {{(pid=103536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:21.579447 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG dbcounter [-] [103536] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:21.978552 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-24812a71-6410-454e-8606-b4a8edee21f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:21.983189 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:12:21.983189 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: warnings.warn(msg) Aug 01 14:12:22.092098 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-24812a71-6410-454e-8606-b4a8edee21f2 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.531905 Aug 01 14:12:22.094107 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 4/6] 10.222.0.17 () {64 vars in 1335 bytes} [Mon Aug 1 14:12:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:25.535435 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-d44eab35-a191-43bd-a04d-1f79be8ba09d admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:25.539424 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-d44eab35-a191-43bd-a04d-1f79be8ba09d admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002706 Aug 01 14:12:25.539424 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 3/7] 10.222.0.17 () {54 vars in 930 bytes} [Mon Aug 1 14:12:25 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:26.904318 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-fe1383bb-255f-4184-a68a-640fbabbe4df admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "name": "ds512M", "rxtx_factor": 1.0, "swap": 0}} {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:26.926782 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:12:26.926782 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: warnings.warn(msg) Aug 01 14:12:26.950183 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-fe1383bb-255f-4184-a68a-640fbabbe4df admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.402450 Aug 01 14:12:26.950794 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 5/8] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Aug 1 14:12:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:12:26.965194 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-ed31e57c-205f-49a4-8411-65d063adcd2d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:26.969407 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:12:26.969407 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: warnings.warn(msg) Aug 01 14:12:27.012384 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-ed31e57c-205f-49a4-8411-65d063adcd2d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051224 Aug 01 14:12:27.013474 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 4/9] 10.222.0.17 () {64 vars in 1335 bytes} [Mon Aug 1 14:12:26 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:30.242744 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-fe1383bb-255f-4184-a68a-640fbabbe4df admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:30.245207 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-fe1383bb-255f-4184-a68a-640fbabbe4df admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002909 Aug 01 14:12:30.248012 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 6/10] 10.222.0.17 () {54 vars in 930 bytes} [Mon Aug 1 14:12:30 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:30.971435 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-ff22960b-9fd0-4e75-baa1-1069d06435b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "id": "d2", "vcpus": 1, "os-flavor-access:is_public": true, "ram": 1024}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:30.994889 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-ff22960b-9fd0-4e75-baa1-1069d06435b1 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.736904 Aug 01 14:12:30.996075 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 5/11] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Aug 1 14:12:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:12:31.013438 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-2e0d2583-d8a6-4527-9fa2-7a0b67ea0cc6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:31.053349 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-2e0d2583-d8a6-4527-9fa2-7a0b67ea0cc6 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046486 Aug 01 14:12:31.054097 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 7/12] 10.222.0.17 () {64 vars in 1335 bytes} [Mon Aug 1 14:12:31 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:34.646959 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-ff22960b-9fd0-4e75-baa1-1069d06435b1 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:34.648860 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-ff22960b-9fd0-4e75-baa1-1069d06435b1 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002520 Aug 01 14:12:34.649727 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 6/13] 10.222.0.17 () {54 vars in 930 bytes} [Mon Aug 1 14:12:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:35.442686 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-611879ae-a055-4127-8d32-54b6e0c270d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "ds2G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:35.473833 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-611879ae-a055-4127-8d32-54b6e0c270d1 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.812503 Aug 01 14:12:35.475220 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 8/14] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Aug 1 14:12:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:12:35.493336 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-b7a92947-6f48-43b6-bac0-98f9046b7f05 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:35.539886 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-b7a92947-6f48-43b6-bac0-98f9046b7f05 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.054195 Aug 01 14:12:35.551486 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 7/15] 10.222.0.17 () {64 vars in 1335 bytes} [Mon Aug 1 14:12:35 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:12:38.083598 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-611879ae-a055-4127-8d32-54b6e0c270d1 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:38.089213 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-611879ae-a055-4127-8d32-54b6e0c270d1 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.006108 Aug 01 14:12:38.091248 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 9/16] 10.222.0.17 () {54 vars in 930 bytes} [Mon Aug 1 14:12:38 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:38.772701 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-70f24b49-a9f9-417a-b8df-c94ea3112317 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "disk": 20, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:38.800700 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-70f24b49-a9f9-417a-b8df-c94ea3112317 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.701906 Aug 01 14:12:38.801620 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 8/17] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Aug 1 14:12:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 14:12:38.821205 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-aa6e250e-5360-4a92-8fbb-c871549b9c39 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:38.858248 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-aa6e250e-5360-4a92-8fbb-c871549b9c39 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042932 Aug 01 14:12:38.859138 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 10/18] 10.222.0.17 () {64 vars in 1335 bytes} [Mon Aug 1 14:12:38 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:41.665424 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-70f24b49-a9f9-417a-b8df-c94ea3112317 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:41.666855 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-70f24b49-a9f9-417a-b8df-c94ea3112317 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002030 Aug 01 14:12:41.667559 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 9/19] 10.222.0.17 () {54 vars in 930 bytes} [Mon Aug 1 14:12:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:12:42.379369 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-b97ff29e-5edc-40c6-8ec2-fa0a52fb6488 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:42.407400 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-b97ff29e-5edc-40c6-8ec2-fa0a52fb6488 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.730644 Aug 01 14:12:42.408012 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 11/20] 10.222.0.17 () {60 vars in 1291 bytes} [Mon Aug 1 14:12:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:45.145973 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-70f24b49-a9f9-417a-b8df-c94ea3112317 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:45.147119 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-70f24b49-a9f9-417a-b8df-c94ea3112317 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001655 Aug 01 14:12:45.147599 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 10/21] 10.222.0.17 () {54 vars in 930 bytes} [Mon Aug 1 14:12:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:45.796019 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-6db1de78-9532-495c-b78e-cc846a8dfaaa admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 1, "ram": 512, "vcpus": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "id": "1"}} {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:45.829308 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-6db1de78-9532-495c-b78e-cc846a8dfaaa admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.674877 Aug 01 14:12:45.830314 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 12/22] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Aug 1 14:12:45 2022] POST /compute/v2.1/flavors => generated 402 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:12:45.852837 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-f2ca9ecb-903f-48d1-b1cc-b04d3f995c8a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:45.862155 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:45.900312 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-f2ca9ecb-903f-48d1-b1cc-b04d3f995c8a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.057032 Aug 01 14:12:45.901145 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 11/23] 10.222.0.17 () {64 vars in 1332 bytes} [Mon Aug 1 14:12:45 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:48.493732 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-6db1de78-9532-495c-b78e-cc846a8dfaaa admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:48.495086 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-6db1de78-9532-495c-b78e-cc846a8dfaaa admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001789 Aug 01 14:12:48.495778 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 930 bytes} [Mon Aug 1 14:12:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:12:49.163599 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-e8abd048-69f3-495e-ab75-d2951c8ce80b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.small", "rxtx_factor": 1.0, "disk": 20, "id": "2", "ram": 2048, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:49.194208 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-e8abd048-69f3-495e-ab75-d2951c8ce80b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.689662 Aug 01 14:12:49.194656 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 12/25] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Aug 1 14:12:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 14:12:49.209459 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-1f34c537-3521-435b-bc1a-697f06023a33 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:49.249869 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-1f34c537-3521-435b-bc1a-697f06023a33 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044686 Aug 01 14:12:49.258920 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 14/26] 10.222.0.17 () {64 vars in 1332 bytes} [Mon Aug 1 14:12:49 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:51.747440 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-e8abd048-69f3-495e-ab75-d2951c8ce80b admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:51.748535 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-e8abd048-69f3-495e-ab75-d2951c8ce80b admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Aug 01 14:12:51.748957 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 13/27] 10.222.0.17 () {54 vars in 930 bytes} [Mon Aug 1 14:12:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:12:52.455280 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-b2e5c141-0e83-4115-9089-558ddd0402c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 40, "id": "3", "ram": 4096, "swap": 0, "rxtx_factor": 1.0}} {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:52.467176 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG dbcounter [-] [103536] Writing DB stats nova_api:SELECT=36,nova_api:SAVEPOINT=4,nova_api:INSERT=7,nova_api:RELEASE=4 {{(pid=103536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:52.496048 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-b2e5c141-0e83-4115-9089-558ddd0402c7 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.738961 Aug 01 14:12:52.496629 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 15/28] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Aug 1 14:12:51 2022] POST /compute/v2.1/flavors => generated 406 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:12:52.512494 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-e19f1419-b719-400d-98a4-ba3b5334c7eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:52.549816 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-e19f1419-b719-400d-98a4-ba3b5334c7eb admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043922 Aug 01 14:12:52.550532 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 14/29] 10.222.0.17 () {64 vars in 1332 bytes} [Mon Aug 1 14:12:52 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:55.475711 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-b2e5c141-0e83-4115-9089-558ddd0402c7 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:55.476736 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-b2e5c141-0e83-4115-9089-558ddd0402c7 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001623 Aug 01 14:12:55.477172 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 16/30] 10.222.0.17 () {54 vars in 930 bytes} [Mon Aug 1 14:12:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:56.193367 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-2a8cefdd-1540-49ee-9d58-c4ae8ce4bd3d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 8192, "name": "m1.large", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 80, "id": "4"}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:56.219613 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-2a8cefdd-1540-49ee-9d58-c4ae8ce4bd3d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.731397 Aug 01 14:12:56.220726 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 15/31] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Aug 1 14:12:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:12:56.238891 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-d2caf54c-f52f-4553-84bd-d7b3a11f245b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:56.282371 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-d2caf54c-f52f-4553-84bd-d7b3a11f245b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049666 Aug 01 14:12:56.283105 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 17/32] 10.222.0.17 () {64 vars in 1332 bytes} [Mon Aug 1 14:12:56 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:58.855263 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-2a8cefdd-1540-49ee-9d58-c4ae8ce4bd3d admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:58.856580 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-2a8cefdd-1540-49ee-9d58-c4ae8ce4bd3d admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001757 Aug 01 14:12:58.868851 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 16/33] 10.222.0.17 () {54 vars in 930 bytes} [Mon Aug 1 14:12:58 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:59.499501 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-8f6e1126-a97c-4461-ac40-cb291d63e8ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "rxtx_factor": 1.0, "disk": 160, "swap": 0, "id": "5", "os-flavor-access:is_public": true, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:59.536209 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-8f6e1126-a97c-4461-ac40-cb291d63e8ec admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.671361 Aug 01 14:12:59.537401 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 18/34] 10.222.0.17 () {64 vars in 1282 bytes} [Mon Aug 1 14:12:58 2022] POST /compute/v2.1/flavors => generated 408 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:12:59.553267 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-fac87506-ace7-4cc1-916d-d6d6102aee8d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:59.582838 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-fac87506-ace7-4cc1-916d-d6d6102aee8d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033638 Aug 01 14:12:59.583718 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 17/35] 10.222.0.17 () {64 vars in 1332 bytes} [Mon Aug 1 14:12:59 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:20.232133 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-8f6e1126-a97c-4461-ac40-cb291d63e8ec admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:20.233184 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-8f6e1126-a97c-4461-ac40-cb291d63e8ec admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002095 Aug 01 14:13:20.233583 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 19/36] 10.222.0.17 () {54 vars in 930 bytes} [Mon Aug 1 14:13:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:13:20.245184 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writing DB stats nova_api:SELECT=23,nova_api:SAVEPOINT=3,nova_api:INSERT=5,nova_api:RELEASE=3 {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:20.766751 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-f3cd7b11-e819-4f3a-b08f-05f0cbdbd5f7 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:20.786650 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-f3cd7b11-e819-4f3a-b08f-05f0cbdbd5f7 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.546070 Aug 01 14:13:20.787230 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 18/37] 10.222.0.17 () {60 vars in 1291 bytes} [Mon Aug 1 14:13:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:13:21.914287 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-8f6e1126-a97c-4461-ac40-cb291d63e8ec admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:21.915231 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-8f6e1126-a97c-4461-ac40-cb291d63e8ec admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 01 14:13:21.915650 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 20/38] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Aug 1 14:13:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:22.542156 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-601e70c2-25ab-4ec1-bdc0-737a7e6a986b admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:22.549399 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.wsgi [None req-601e70c2-25ab-4ec1-bdc0-737a7e6a986b admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 01 14:13:22.553345 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-601e70c2-25ab-4ec1-bdc0-737a7e6a986b admin admin] Request method failure captured: Aug 01 14:13:22.553345 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 01 14:13:22.553345 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: Accept: application/json Aug 01 14:13:22.553345 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: Accept-Encoding: gzip, deflate Aug 01 14:13:22.553345 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: Connection: keep-alive Aug 01 14:13:22.553345 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: Content-Length: 0 Aug 01 14:13:22.553345 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: Host: 10.222.0.17 Aug 01 14:13:22.553345 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: Openstack-Api-Version: compute 2.90 Aug 01 14:13:22.553345 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: Openstack-System-Scope: None Aug 01 14:13:22.553345 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: User-Agent: python-novaclient Aug 01 14:13:22.553345 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Auth-Token: gAAAAABi59-BP-_bLcG8AuSTJh-y1c1pqn8B3Hdn3kOwk8XsnqEQtRCL84gCpt6xS4Q4MTaNDDfI7u1LPUn6K2RWH6Lms5o9ZtgsJPE6j4Y8T524INijjmprh7EY6zZeSSNRTm3LUKp7eTun7CVUgWZy3uCJlReLE5mPi_PPAD8mq9w27lV3F0o Aug 01 14:13:22.553345 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Domain-Id: None Aug 01 14:13:22.553345 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Domain-Name: None Aug 01 14:13:22.553345 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Identity-Status: Confirmed Aug 01 14:13:22.553345 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Is-Admin-Project: True Aug 01 14:13:22.553345 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 14:13:22.553345 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Project-Domain-Id: default Aug 01 14:13:22.553345 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Project-Domain-Name: Default Aug 01 14:13:22.553345 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Project-Id: 045f384688624ccf8339b3c71e2bd890 Aug 01 14:13:22.553345 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Project-Name: admin Aug 01 14:13:22.553345 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Role: reader,admin,member Aug 01 14:13:22.553345 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Roles: reader,admin,member Aug 01 14:13:22.555998 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/045f384688624ccf8339b3c71e2bd890"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/045f384688624ccf8339b3c71e2bd890"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/045f384688624ccf8339b3c71e2bd890"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_045f384688624ccf8339b3c71e2bd890", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:13:22.555998 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Tenant: admin Aug 01 14:13:22.555998 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Tenant-Id: 045f384688624ccf8339b3c71e2bd890 Aug 01 14:13:22.555998 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Tenant-Name: admin Aug 01 14:13:22.555998 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-User: admin Aug 01 14:13:22.555998 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-User-Domain-Id: default Aug 01 14:13:22.555998 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-User-Domain-Name: Default Aug 01 14:13:22.555998 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-User-Id: 65c8d33b0a3b4ecb82a05c93cec78423 Aug 01 14:13:22.555998 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-User-Name: admin Aug 01 14:13:22.555998 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: method: > Aug 01 14:13:22.555998 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: exception: Flavor 42 could not be found. Aug 01 14:13:22.555998 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: action_args: {'id': '42'} Aug 01 14:13:22.555998 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:13:22.555998 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:22.557621 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 14:13:22.557621 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 14:13:22.557621 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 14:13:22.557621 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 14:13:22.557621 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 14:13:22.557621 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 14:13:22.557621 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 14:13:22.557621 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 14:13:22.557621 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 14:13:22.557621 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:13:22.557621 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 14:13:22.557621 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 14:13:22.557621 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 01 14:13:22.557621 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 01 14:13:22.557621 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:22.557621 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 01 14:13:22.557621 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:22.557621 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:22.557621 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:22.560601 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:13:22.560601 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:13:22.560601 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:13:22.560601 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:13:22.560601 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 14:13:22.560601 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:13:22.560601 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 01 14:13:22.560601 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 01 14:13:22.560601 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:22.560601 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 01 14:13:22.560601 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:22.560601 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:22.560601 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:22.560601 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:13:22.560601 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:13:22.560601 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 01 14:13:22.560601 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 01 14:13:22.560601 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-601e70c2-25ab-4ec1-bdc0-737a7e6a986b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:13:22.562807 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-601e70c2-25ab-4ec1-bdc0-737a7e6a986b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.499103 Aug 01 14:13:22.562807 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 19/39] 10.222.0.17 () {60 vars in 1190 bytes} [Mon Aug 1 14:13:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 501 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:22.568623 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-df6fb8b8-69b1-419b-97d8-3485a7d9903d admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:22.572725 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG dbcounter [-] [103536] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=11,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:22.595355 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-df6fb8b8-69b1-419b-97d8-3485a7d9903d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030165 Aug 01 14:13:22.595979 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 21/40] 10.222.0.17 () {60 vars in 1210 bytes} [Mon Aug 1 14:13:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:13:22.606216 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-b17076c8-a325-48ed-aed9-884c7b587d4b admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:22.636236 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-b17076c8-a325-48ed-aed9-884c7b587d4b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.033636 Aug 01 14:13:22.636813 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 20/41] 10.222.0.17 () {60 vars in 1210 bytes} [Mon Aug 1 14:13:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:13:22.650826 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-83875d64-b0df-4e4f-873b-bb9cf0b36382 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:22.663306 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.wsgi [None req-83875d64-b0df-4e4f-873b-bb9cf0b36382 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 01 14:13:22.667013 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-83875d64-b0df-4e4f-873b-bb9cf0b36382 admin admin] Request method failure captured: Aug 01 14:13:22.667013 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 01 14:13:22.667013 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: Accept: application/json Aug 01 14:13:22.667013 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: Accept-Encoding: gzip, deflate Aug 01 14:13:22.667013 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: Connection: keep-alive Aug 01 14:13:22.667013 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: Content-Length: 0 Aug 01 14:13:22.667013 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: Host: 10.222.0.17 Aug 01 14:13:22.667013 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: Openstack-Api-Version: compute 2.90 Aug 01 14:13:22.667013 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: Openstack-System-Scope: None Aug 01 14:13:22.667013 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: User-Agent: python-novaclient Aug 01 14:13:22.667013 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Auth-Token: gAAAAABi59-BP-_bLcG8AuSTJh-y1c1pqn8B3Hdn3kOwk8XsnqEQtRCL84gCpt6xS4Q4MTaNDDfI7u1LPUn6K2RWH6Lms5o9ZtgsJPE6j4Y8T524INijjmprh7EY6zZeSSNRTm3LUKp7eTun7CVUgWZy3uCJlReLE5mPi_PPAD8mq9w27lV3F0o Aug 01 14:13:22.667013 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Domain-Id: None Aug 01 14:13:22.667013 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Domain-Name: None Aug 01 14:13:22.667013 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Identity-Status: Confirmed Aug 01 14:13:22.667013 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Is-Admin-Project: True Aug 01 14:13:22.667013 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 14:13:22.667013 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Project-Domain-Id: default Aug 01 14:13:22.667013 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Project-Domain-Name: Default Aug 01 14:13:22.667013 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Project-Id: 045f384688624ccf8339b3c71e2bd890 Aug 01 14:13:22.667013 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Project-Name: admin Aug 01 14:13:22.667013 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Role: reader,admin,member Aug 01 14:13:22.667013 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Roles: reader,admin,member Aug 01 14:13:22.668611 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/045f384688624ccf8339b3c71e2bd890"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/045f384688624ccf8339b3c71e2bd890"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/045f384688624ccf8339b3c71e2bd890"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_045f384688624ccf8339b3c71e2bd890", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:13:22.668611 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Tenant: admin Aug 01 14:13:22.668611 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Tenant-Id: 045f384688624ccf8339b3c71e2bd890 Aug 01 14:13:22.668611 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Tenant-Name: admin Aug 01 14:13:22.668611 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-User: admin Aug 01 14:13:22.668611 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-User-Domain-Id: default Aug 01 14:13:22.668611 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-User-Domain-Name: Default Aug 01 14:13:22.668611 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-User-Id: 65c8d33b0a3b4ecb82a05c93cec78423 Aug 01 14:13:22.668611 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-User-Name: admin Aug 01 14:13:22.668611 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: method: > Aug 01 14:13:22.668611 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: exception: Flavor 42 could not be found. Aug 01 14:13:22.668611 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: action_args: {'id': '42'} Aug 01 14:13:22.668611 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:13:22.668611 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:22.670632 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 14:13:22.670632 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 14:13:22.670632 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 14:13:22.670632 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 14:13:22.670632 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 14:13:22.670632 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 14:13:22.670632 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 14:13:22.670632 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 14:13:22.670632 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 14:13:22.670632 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:13:22.670632 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 14:13:22.670632 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 14:13:22.670632 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 01 14:13:22.670632 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 01 14:13:22.670632 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:22.670632 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 01 14:13:22.670632 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:22.670632 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:22.670632 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:22.671785 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:13:22.671785 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:13:22.671785 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:13:22.671785 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:13:22.671785 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 14:13:22.671785 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:13:22.671785 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 01 14:13:22.671785 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 01 14:13:22.671785 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:22.671785 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 01 14:13:22.671785 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:22.671785 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:22.671785 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:22.671785 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:13:22.671785 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:13:22.671785 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 01 14:13:22.671785 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 01 14:13:22.671785 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-83875d64-b0df-4e4f-873b-bb9cf0b36382 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:13:22.672825 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-83875d64-b0df-4e4f-873b-bb9cf0b36382 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.024816 Aug 01 14:13:22.672825 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 22/42] 10.222.0.17 () {60 vars in 1190 bytes} [Mon Aug 1 14:13:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:23.709822 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-b17076c8-a325-48ed-aed9-884c7b587d4b admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:23.710882 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-b17076c8-a325-48ed-aed9-884c7b587d4b admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 01 14:13:23.711553 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 21/43] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Aug 1 14:13:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:13:24.351334 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-e64defd6-dc5b-46b6-943e-90b01959cdb9 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:24.357931 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.wsgi [None req-e64defd6-dc5b-46b6-943e-90b01959cdb9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 01 14:13:24.359481 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-e64defd6-dc5b-46b6-943e-90b01959cdb9 admin admin] Request method failure captured: Aug 01 14:13:24.359481 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 01 14:13:24.359481 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: Accept: application/json Aug 01 14:13:24.359481 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: Accept-Encoding: gzip, deflate Aug 01 14:13:24.359481 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: Connection: keep-alive Aug 01 14:13:24.359481 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: Content-Length: 0 Aug 01 14:13:24.359481 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: Host: 10.222.0.17 Aug 01 14:13:24.359481 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: Openstack-Api-Version: compute 2.90 Aug 01 14:13:24.359481 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: Openstack-System-Scope: None Aug 01 14:13:24.359481 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: User-Agent: python-novaclient Aug 01 14:13:24.359481 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Auth-Token: gAAAAABi59-DtyItf-siShPi4NV7ZFYT-2OjA-MYvypo6GepOQhYogJ9qQ8kjllisgq4QENB64O9nIBGoH_WW3KktVSseUCkQyYL3dbRhdIHb_mFXtB_1FcUIBGzLaP0f0Hiukb7TjCa3z6BXshGOqyWU8xxWDbbPUDKFvM4TnelC-Ywelyc2FI Aug 01 14:13:24.359481 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Domain-Id: None Aug 01 14:13:24.359481 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Domain-Name: None Aug 01 14:13:24.359481 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Identity-Status: Confirmed Aug 01 14:13:24.359481 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Is-Admin-Project: True Aug 01 14:13:24.359481 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 14:13:24.359481 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Project-Domain-Id: default Aug 01 14:13:24.359481 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Project-Domain-Name: Default Aug 01 14:13:24.359481 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Project-Id: 045f384688624ccf8339b3c71e2bd890 Aug 01 14:13:24.359481 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Project-Name: admin Aug 01 14:13:24.359481 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Role: reader,admin,member Aug 01 14:13:24.359481 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Roles: reader,admin,member Aug 01 14:13:24.360716 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/045f384688624ccf8339b3c71e2bd890"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/045f384688624ccf8339b3c71e2bd890"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/045f384688624ccf8339b3c71e2bd890"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_045f384688624ccf8339b3c71e2bd890", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:13:24.360716 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Tenant: admin Aug 01 14:13:24.360716 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Tenant-Id: 045f384688624ccf8339b3c71e2bd890 Aug 01 14:13:24.360716 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Tenant-Name: admin Aug 01 14:13:24.360716 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-User: admin Aug 01 14:13:24.360716 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-User-Domain-Id: default Aug 01 14:13:24.360716 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-User-Domain-Name: Default Aug 01 14:13:24.360716 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-User-Id: 65c8d33b0a3b4ecb82a05c93cec78423 Aug 01 14:13:24.360716 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-User-Name: admin Aug 01 14:13:24.360716 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: method: > Aug 01 14:13:24.360716 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: exception: Flavor 84 could not be found. Aug 01 14:13:24.360716 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: action_args: {'id': '84'} Aug 01 14:13:24.360716 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:13:24.360716 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:24.361479 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 14:13:24.361479 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 14:13:24.361479 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 14:13:24.361479 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 14:13:24.361479 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 14:13:24.361479 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 14:13:24.361479 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 14:13:24.361479 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 14:13:24.361479 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 14:13:24.361479 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:13:24.361479 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 14:13:24.361479 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 14:13:24.361479 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 01 14:13:24.361479 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 01 14:13:24.361479 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:24.361479 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 01 14:13:24.361479 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:24.361479 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:24.361479 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:24.362764 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:13:24.362764 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:13:24.362764 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:13:24.362764 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:13:24.362764 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 14:13:24.362764 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:13:24.362764 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 01 14:13:24.362764 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 01 14:13:24.362764 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:24.362764 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 01 14:13:24.362764 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:24.362764 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:24.362764 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:24.362764 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:13:24.362764 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:13:24.362764 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 01 14:13:24.362764 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 01 14:13:24.362764 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-e64defd6-dc5b-46b6-943e-90b01959cdb9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:13:24.364047 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-e64defd6-dc5b-46b6-943e-90b01959cdb9 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.494238 Aug 01 14:13:24.364047 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 23/44] 10.222.0.17 () {60 vars in 1190 bytes} [Mon Aug 1 14:13:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 495 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:24.373853 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-a0c33393-dfea-4828-a0a7-0dccac1157e0 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:24.400806 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-a0c33393-dfea-4828-a0a7-0dccac1157e0 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.033245 Aug 01 14:13:24.401847 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 22/45] 10.222.0.17 () {60 vars in 1210 bytes} [Mon Aug 1 14:13:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:24.416189 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-6f2eac5b-a21d-4d2f-9f8a-3916b6ed0fe8 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:24.438795 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-6f2eac5b-a21d-4d2f-9f8a-3916b6ed0fe8 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026617 Aug 01 14:13:24.439640 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 24/46] 10.222.0.17 () {60 vars in 1210 bytes} [Mon Aug 1 14:13:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:24.454294 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-b6d062d0-0d6d-4460-a3ac-de4444ee3029 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:24.460682 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.wsgi [None req-b6d062d0-0d6d-4460-a3ac-de4444ee3029 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 01 14:13:24.462235 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-b6d062d0-0d6d-4460-a3ac-de4444ee3029 admin admin] Request method failure captured: Aug 01 14:13:24.462235 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 01 14:13:24.462235 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: Accept: application/json Aug 01 14:13:24.462235 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: Accept-Encoding: gzip, deflate Aug 01 14:13:24.462235 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: Connection: keep-alive Aug 01 14:13:24.462235 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: Content-Length: 0 Aug 01 14:13:24.462235 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: Host: 10.222.0.17 Aug 01 14:13:24.462235 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: Openstack-Api-Version: compute 2.90 Aug 01 14:13:24.462235 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: Openstack-System-Scope: None Aug 01 14:13:24.462235 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: User-Agent: python-novaclient Aug 01 14:13:24.462235 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Auth-Token: gAAAAABi59-DtyItf-siShPi4NV7ZFYT-2OjA-MYvypo6GepOQhYogJ9qQ8kjllisgq4QENB64O9nIBGoH_WW3KktVSseUCkQyYL3dbRhdIHb_mFXtB_1FcUIBGzLaP0f0Hiukb7TjCa3z6BXshGOqyWU8xxWDbbPUDKFvM4TnelC-Ywelyc2FI Aug 01 14:13:24.462235 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Domain-Id: None Aug 01 14:13:24.462235 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Domain-Name: None Aug 01 14:13:24.462235 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Identity-Status: Confirmed Aug 01 14:13:24.462235 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Is-Admin-Project: True Aug 01 14:13:24.462235 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 14:13:24.462235 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Project-Domain-Id: default Aug 01 14:13:24.462235 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Project-Domain-Name: Default Aug 01 14:13:24.462235 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Project-Id: 045f384688624ccf8339b3c71e2bd890 Aug 01 14:13:24.462235 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Project-Name: admin Aug 01 14:13:24.462235 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Role: reader,admin,member Aug 01 14:13:24.462235 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Roles: reader,admin,member Aug 01 14:13:24.464232 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/045f384688624ccf8339b3c71e2bd890"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/045f384688624ccf8339b3c71e2bd890"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/045f384688624ccf8339b3c71e2bd890"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_045f384688624ccf8339b3c71e2bd890", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:13:24.464232 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Tenant: admin Aug 01 14:13:24.464232 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Tenant-Id: 045f384688624ccf8339b3c71e2bd890 Aug 01 14:13:24.464232 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Tenant-Name: admin Aug 01 14:13:24.464232 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-User: admin Aug 01 14:13:24.464232 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-User-Domain-Id: default Aug 01 14:13:24.464232 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-User-Domain-Name: Default Aug 01 14:13:24.464232 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-User-Id: 65c8d33b0a3b4ecb82a05c93cec78423 Aug 01 14:13:24.464232 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-User-Name: admin Aug 01 14:13:24.464232 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: method: > Aug 01 14:13:24.464232 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: exception: Flavor 84 could not be found. Aug 01 14:13:24.464232 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: action_args: {'id': '84'} Aug 01 14:13:24.464232 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:13:24.464232 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:24.465757 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 14:13:24.465757 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 14:13:24.465757 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 14:13:24.465757 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 14:13:24.465757 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 14:13:24.465757 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 14:13:24.465757 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 14:13:24.465757 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 14:13:24.465757 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 14:13:24.465757 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:13:24.465757 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 14:13:24.465757 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 14:13:24.465757 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 01 14:13:24.465757 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 01 14:13:24.465757 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:24.465757 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 01 14:13:24.465757 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:24.465757 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:24.465757 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:24.467194 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:13:24.467194 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:13:24.467194 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:13:24.467194 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:13:24.467194 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 14:13:24.467194 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:13:24.467194 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 01 14:13:24.467194 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 01 14:13:24.467194 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:24.467194 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 01 14:13:24.467194 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:24.467194 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:24.467194 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:24.467194 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:13:24.467194 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:13:24.467194 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 01 14:13:24.467194 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 01 14:13:24.467194 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-b6d062d0-0d6d-4460-a3ac-de4444ee3029 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:13:24.468538 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-b6d062d0-0d6d-4460-a3ac-de4444ee3029 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.016352 Aug 01 14:13:24.468538 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 23/47] 10.222.0.17 () {60 vars in 1190 bytes} [Mon Aug 1 14:13:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:25.601325 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-6f2eac5b-a21d-4d2f-9f8a-3916b6ed0fe8 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:25.602392 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-6f2eac5b-a21d-4d2f-9f8a-3916b6ed0fe8 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001622 Aug 01 14:13:25.602870 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 25/48] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Aug 1 14:13:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:26.239337 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-f6464eae-61cc-448b-876a-89b970d2ab21 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:26.249371 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.wsgi [None req-f6464eae-61cc-448b-876a-89b970d2ab21 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 01 14:13:26.251333 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-f6464eae-61cc-448b-876a-89b970d2ab21 admin admin] Request method failure captured: Aug 01 14:13:26.251333 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 01 14:13:26.251333 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: Accept: application/json Aug 01 14:13:26.251333 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: Accept-Encoding: gzip, deflate Aug 01 14:13:26.251333 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: Connection: keep-alive Aug 01 14:13:26.251333 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: Content-Length: 0 Aug 01 14:13:26.251333 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: Host: 10.222.0.17 Aug 01 14:13:26.251333 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: Openstack-Api-Version: compute 2.90 Aug 01 14:13:26.251333 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: Openstack-System-Scope: None Aug 01 14:13:26.251333 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: User-Agent: python-novaclient Aug 01 14:13:26.251333 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Auth-Token: gAAAAABi59-Fsvot878KxNkaoCa3Vhl_a_KeVWANWKbGxS2giyrfpfUUbzea2ofxuo8UwSntGPtrZwa6DWXVA0jaA0ni20FwKLr-D5SWjuWsO02eJ8tPTpwe3qUAGnd2YwO4TMCpELfumPAKoeVwbT8RdIRRGxRukC2yMXISqLnbJTEqzexAris Aug 01 14:13:26.251333 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Domain-Id: None Aug 01 14:13:26.251333 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Domain-Name: None Aug 01 14:13:26.251333 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Identity-Status: Confirmed Aug 01 14:13:26.251333 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Is-Admin-Project: True Aug 01 14:13:26.251333 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 14:13:26.251333 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Project-Domain-Id: default Aug 01 14:13:26.251333 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Project-Domain-Name: Default Aug 01 14:13:26.251333 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Project-Id: 045f384688624ccf8339b3c71e2bd890 Aug 01 14:13:26.251333 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Project-Name: admin Aug 01 14:13:26.251333 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Role: reader,admin,member Aug 01 14:13:26.251333 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Roles: reader,admin,member Aug 01 14:13:26.252865 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/045f384688624ccf8339b3c71e2bd890"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/045f384688624ccf8339b3c71e2bd890"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/045f384688624ccf8339b3c71e2bd890"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_045f384688624ccf8339b3c71e2bd890", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:13:26.252865 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Tenant: admin Aug 01 14:13:26.252865 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Tenant-Id: 045f384688624ccf8339b3c71e2bd890 Aug 01 14:13:26.252865 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-Tenant-Name: admin Aug 01 14:13:26.252865 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-User: admin Aug 01 14:13:26.252865 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-User-Domain-Id: default Aug 01 14:13:26.252865 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-User-Domain-Name: Default Aug 01 14:13:26.252865 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-User-Id: 65c8d33b0a3b4ecb82a05c93cec78423 Aug 01 14:13:26.252865 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: X-User-Name: admin Aug 01 14:13:26.252865 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: method: > Aug 01 14:13:26.252865 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: exception: Flavor 451 could not be found. Aug 01 14:13:26.252865 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: action_args: {'id': '451'} Aug 01 14:13:26.252865 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:13:26.252865 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:26.253690 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 14:13:26.253690 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 14:13:26.253690 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 14:13:26.253690 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 14:13:26.253690 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 14:13:26.253690 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 14:13:26.253690 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 14:13:26.253690 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 14:13:26.253690 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 14:13:26.253690 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:13:26.253690 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 14:13:26.253690 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 14:13:26.253690 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 01 14:13:26.253690 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 01 14:13:26.253690 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:26.253690 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 01 14:13:26.253690 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:26.253690 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:26.253690 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:26.254802 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:13:26.254802 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:13:26.254802 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:13:26.254802 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:13:26.254802 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 14:13:26.254802 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:13:26.254802 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 01 14:13:26.254802 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 01 14:13:26.254802 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:26.254802 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 01 14:13:26.254802 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:26.254802 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:26.254802 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:26.254802 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:13:26.254802 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:13:26.254802 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 01 14:13:26.254802 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Aug 01 14:13:26.254802 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-f6464eae-61cc-448b-876a-89b970d2ab21 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:13:26.255878 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-f6464eae-61cc-448b-876a-89b970d2ab21 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.499509 Aug 01 14:13:26.255878 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 24/49] 10.222.0.17 () {60 vars in 1193 bytes} [Mon Aug 1 14:13:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 501 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:26.265788 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-9bebbd8d-8e81-4fe6-88f1-1ce05ac200df admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:26.283263 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-9bebbd8d-8e81-4fe6-88f1-1ce05ac200df admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021944 Aug 01 14:13:26.283862 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 26/50] 10.222.0.17 () {60 vars in 1210 bytes} [Mon Aug 1 14:13:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:26.294585 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-7abd0f6b-bfb3-4c72-a5aa-345805cd27a2 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:26.310839 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-7abd0f6b-bfb3-4c72-a5aa-345805cd27a2 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019776 Aug 01 14:13:26.311416 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 25/51] 10.222.0.17 () {60 vars in 1210 bytes} [Mon Aug 1 14:13:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:13:26.321160 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-2ca4db32-3eb3-4fee-9929-80440f0602b5 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:26.327220 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.wsgi [None req-2ca4db32-3eb3-4fee-9929-80440f0602b5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 01 14:13:26.328789 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-2ca4db32-3eb3-4fee-9929-80440f0602b5 admin admin] Request method failure captured: Aug 01 14:13:26.328789 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 01 14:13:26.328789 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: Accept: application/json Aug 01 14:13:26.328789 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: Accept-Encoding: gzip, deflate Aug 01 14:13:26.328789 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: Connection: keep-alive Aug 01 14:13:26.328789 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: Content-Length: 0 Aug 01 14:13:26.328789 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: Host: 10.222.0.17 Aug 01 14:13:26.328789 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: Openstack-Api-Version: compute 2.90 Aug 01 14:13:26.328789 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: Openstack-System-Scope: None Aug 01 14:13:26.328789 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: User-Agent: python-novaclient Aug 01 14:13:26.328789 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Auth-Token: gAAAAABi59-Fsvot878KxNkaoCa3Vhl_a_KeVWANWKbGxS2giyrfpfUUbzea2ofxuo8UwSntGPtrZwa6DWXVA0jaA0ni20FwKLr-D5SWjuWsO02eJ8tPTpwe3qUAGnd2YwO4TMCpELfumPAKoeVwbT8RdIRRGxRukC2yMXISqLnbJTEqzexAris Aug 01 14:13:26.328789 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Domain-Id: None Aug 01 14:13:26.328789 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Domain-Name: None Aug 01 14:13:26.328789 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Identity-Status: Confirmed Aug 01 14:13:26.328789 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Is-Admin-Project: True Aug 01 14:13:26.328789 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 14:13:26.328789 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Project-Domain-Id: default Aug 01 14:13:26.328789 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Project-Domain-Name: Default Aug 01 14:13:26.328789 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Project-Id: 045f384688624ccf8339b3c71e2bd890 Aug 01 14:13:26.328789 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Project-Name: admin Aug 01 14:13:26.328789 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Role: reader,admin,member Aug 01 14:13:26.328789 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Roles: reader,admin,member Aug 01 14:13:26.331024 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/045f384688624ccf8339b3c71e2bd890"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/045f384688624ccf8339b3c71e2bd890"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/045f384688624ccf8339b3c71e2bd890"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_045f384688624ccf8339b3c71e2bd890", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:13:26.331024 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Tenant: admin Aug 01 14:13:26.331024 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Tenant-Id: 045f384688624ccf8339b3c71e2bd890 Aug 01 14:13:26.331024 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-Tenant-Name: admin Aug 01 14:13:26.331024 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-User: admin Aug 01 14:13:26.331024 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-User-Domain-Id: default Aug 01 14:13:26.331024 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-User-Domain-Name: Default Aug 01 14:13:26.331024 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-User-Id: 65c8d33b0a3b4ecb82a05c93cec78423 Aug 01 14:13:26.331024 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: X-User-Name: admin Aug 01 14:13:26.331024 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: method: > Aug 01 14:13:26.331024 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: exception: Flavor 451 could not be found. Aug 01 14:13:26.331024 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: action_args: {'id': '451'} Aug 01 14:13:26.331024 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:13:26.331024 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:26.332070 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 14:13:26.332070 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 14:13:26.332070 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 14:13:26.332070 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 14:13:26.332070 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 14:13:26.332070 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 14:13:26.332070 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 14:13:26.332070 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 14:13:26.332070 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 14:13:26.332070 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:13:26.332070 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 14:13:26.332070 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 14:13:26.332070 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 01 14:13:26.332070 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 01 14:13:26.332070 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:26.332070 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 01 14:13:26.332070 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:26.332070 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:26.332070 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:26.333902 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:13:26.333902 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:13:26.333902 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:13:26.333902 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:13:26.333902 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 14:13:26.333902 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:13:26.333902 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 01 14:13:26.333902 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 01 14:13:26.333902 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:26.333902 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 01 14:13:26.333902 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:26.333902 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:26.333902 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:26.333902 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:13:26.333902 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:13:26.333902 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 01 14:13:26.333902 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: ERROR nova.api.openstack.wsgi Aug 01 14:13:26.333902 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-2ca4db32-3eb3-4fee-9929-80440f0602b5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:13:26.335592 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-2ca4db32-3eb3-4fee-9929-80440f0602b5 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012640 Aug 01 14:13:26.335592 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 27/52] 10.222.0.17 () {60 vars in 1193 bytes} [Mon Aug 1 14:13:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:27.604821 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-7abd0f6b-bfb3-4c72-a5aa-345805cd27a2 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:27.605856 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-7abd0f6b-bfb3-4c72-a5aa-345805cd27a2 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 01 14:13:27.606261 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 26/53] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Aug 1 14:13:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:13:28.427990 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-e8481685-1226-4dca-8f55-8478396c404b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:28.451849 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-e8481685-1226-4dca-8f55-8478396c404b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.690207 Aug 01 14:13:28.452403 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 28/54] 10.222.0.17 () {64 vars in 1235 bytes} [Mon Aug 1 14:13:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:13:29.542747 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-7abd0f6b-bfb3-4c72-a5aa-345805cd27a2 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:29.544063 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-7abd0f6b-bfb3-4c72-a5aa-345805cd27a2 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 01 14:13:29.544488 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 27/55] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Aug 1 14:13:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:30.170403 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-4a81538e-da07-45a0-97c8-b2e4ae27766a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:30.195984 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-4a81538e-da07-45a0-97c8-b2e4ae27766a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.501602 Aug 01 14:13:30.197017 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 29/56] 10.222.0.17 () {64 vars in 1235 bytes} [Mon Aug 1 14:13:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:13:31.297396 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-7abd0f6b-bfb3-4c72-a5aa-345805cd27a2 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:31.298464 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-7abd0f6b-bfb3-4c72-a5aa-345805cd27a2 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 01 14:13:31.298877 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 28/57] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Aug 1 14:13:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:13:32.011067 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-9931f47a-f444-40e0-a646-0b04489a99cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:32.045606 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-9931f47a-f444-40e0-a646-0b04489a99cb admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.568549 Aug 01 14:13:32.046604 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 30/58] 10.222.0.17 () {64 vars in 1235 bytes} [Mon Aug 1 14:13:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 14:13:33.215903 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-7abd0f6b-bfb3-4c72-a5aa-345805cd27a2 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:33.217635 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-7abd0f6b-bfb3-4c72-a5aa-345805cd27a2 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003060 Aug 01 14:13:33.218322 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 29/59] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Aug 1 14:13:33 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:33.850665 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-edf7f3a0-4042-4402-aa7e-cea55299ab12 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:33.874303 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-edf7f3a0-4042-4402-aa7e-cea55299ab12 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.499456 Aug 01 14:13:33.874946 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 31/60] 10.222.0.17 () {64 vars in 1235 bytes} [Mon Aug 1 14:13:33 2022] POST /compute/v2.1/flavors => generated 409 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:13:34.928386 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-7abd0f6b-bfb3-4c72-a5aa-345805cd27a2 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:34.929434 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-7abd0f6b-bfb3-4c72-a5aa-345805cd27a2 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 01 14:13:34.929846 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 30/61] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Aug 1 14:13:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:35.581309 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-b8e8f2c6-4016-49b9-9864-cd3b7ed791d9 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:35.608672 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-b8e8f2c6-4016-49b9-9864-cd3b7ed791d9 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.531552 Aug 01 14:13:35.609241 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 32/62] 10.222.0.17 () {60 vars in 1202 bytes} [Mon Aug 1 14:13:35 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:14:34.954937 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-7abd0f6b-bfb3-4c72-a5aa-345805cd27a2 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:34.956153 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-7abd0f6b-bfb3-4c72-a5aa-345805cd27a2 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001603 Aug 01 14:14:34.956598 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 31/63] 10.222.0.17 () {54 vars in 930 bytes} [Mon Aug 1 14:14:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:14:34.972222 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG dbcounter [-] [103536] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:35.516011 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-9a7cc3cb-3afa-4cfb-83a4-72c7882dd0da admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:35.552078 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-9a7cc3cb-3afa-4cfb-83a4-72c7882dd0da admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.586832 Aug 01 14:14:35.552933 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 33/64] 10.222.0.17 () {60 vars in 1291 bytes} [Mon Aug 1 14:14:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:14:35.581184 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-5a56f1c0-7948-4867-b07b-25cbcbf85ed8 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:35.584729 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writing DB stats nova_api:SELECT=14 {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:35.590614 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-5a56f1c0-7948-4867-b07b-25cbcbf85ed8 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015348 Aug 01 14:14:35.591185 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 32/65] 10.222.0.17 () {60 vars in 1282 bytes} [Mon Aug 1 14:14:35 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:35.603645 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-62b2db78-702a-47fa-9d73-efa391bcdc42 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:35.613106 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-62b2db78-702a-47fa-9d73-efa391bcdc42 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013443 Aug 01 14:14:35.613663 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 34/66] 10.222.0.17 () {60 vars in 1285 bytes} [Mon Aug 1 14:14:35 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:35.626951 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-8ae8d743-0ac8-43ad-a0f5-bf3db3a1e952 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:35.636153 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-8ae8d743-0ac8-43ad-a0f5-bf3db3a1e952 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013352 Aug 01 14:14:35.636718 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 33/67] 10.222.0.17 () {60 vars in 1285 bytes} [Mon Aug 1 14:14:35 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:35.652610 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-84e6eeee-f536-4de0-ac12-536e2108b546 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:35.661172 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-84e6eeee-f536-4de0-ac12-536e2108b546 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013367 Aug 01 14:14:35.661743 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 35/68] 10.222.0.17 () {60 vars in 1282 bytes} [Mon Aug 1 14:14:35 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:05.721980 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-8ae8d743-0ac8-43ad-a0f5-bf3db3a1e952 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:05.723664 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-8ae8d743-0ac8-43ad-a0f5-bf3db3a1e952 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001896 Aug 01 14:18:05.724272 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 34/69] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Aug 1 14:18:05 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:18:05.888974 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG dbcounter [-] [103536] Writing DB stats nova_api:SELECT=6 {{(pid=103536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:06.050190 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-18f03a87-af1a-44b2-b8d5-de4645a640b7 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:06.052634 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:18:06.052634 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: warnings.warn(msg) Aug 01 14:18:06.053869 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG oslo_concurrency.lockutils [None req-18f03a87-af1a-44b2-b8d5-de4645a640b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:06.054314 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG oslo_concurrency.lockutils [None req-18f03a87-af1a-44b2-b8d5-de4645a640b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:06.055145 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG oslo_concurrency.lockutils [None req-18f03a87-af1a-44b2-b8d5-de4645a640b7 admin admin] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:06.055612 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG oslo_concurrency.lockutils [None req-18f03a87-af1a-44b2-b8d5-de4645a640b7 admin admin] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:06.089815 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-18f03a87-af1a-44b2-b8d5-de4645a640b7 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.202377 Aug 01 14:18:06.090402 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 36/70] 10.222.0.17 () {60 vars in 1193 bytes} [Mon Aug 1 14:18:05 2022] GET /compute/v2.1/os-services => generated 791 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:18:06.968553 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-8ae8d743-0ac8-43ad-a0f5-bf3db3a1e952 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:06.969556 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-8ae8d743-0ac8-43ad-a0f5-bf3db3a1e952 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 01 14:18:06.969939 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 35/71] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Aug 1 14:18:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:18:07.165136 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-40b89da8-366b-4f4e-8399-7108e7e5947d admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:07.167626 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:18:07.167626 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: warnings.warn(msg) Aug 01 14:18:07.168825 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG oslo_concurrency.lockutils [None req-40b89da8-366b-4f4e-8399-7108e7e5947d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:07.169269 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG oslo_concurrency.lockutils [None req-40b89da8-366b-4f4e-8399-7108e7e5947d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:07.170079 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG oslo_concurrency.lockutils [None req-40b89da8-366b-4f4e-8399-7108e7e5947d admin admin] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:07.170503 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG oslo_concurrency.lockutils [None req-40b89da8-366b-4f4e-8399-7108e7e5947d admin admin] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:07.190569 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-40b89da8-366b-4f4e-8399-7108e7e5947d admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080952 Aug 01 14:18:07.191171 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 37/72] 10.222.0.17 () {60 vars in 1193 bytes} [Mon Aug 1 14:18:07 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 14:18:18.493655 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-8ae8d743-0ac8-43ad-a0f5-bf3db3a1e952 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:18.494742 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-8ae8d743-0ac8-43ad-a0f5-bf3db3a1e952 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 01 14:18:18.495143 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 36/73] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Aug 1 14:18:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:18:18.653841 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG dbcounter [-] [103536] Writing DB stats nova_cell0:SELECT=4 {{(pid=103536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:18.654568 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG dbcounter [-] [103536] Writing DB stats nova_cell1:SELECT=4 {{(pid=103536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:18.655184 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG dbcounter [-] [103536] Writing DB stats nova_api:SELECT=8 {{(pid=103536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:18.708668 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-6dbe7cc3-5e86-4141-8a4c-a652dc1066c9 admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:18.711143 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:18:18.711143 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: warnings.warn(msg) Aug 01 14:18:18.712389 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG oslo_concurrency.lockutils [None req-6dbe7cc3-5e86-4141-8a4c-a652dc1066c9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:18.712858 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG oslo_concurrency.lockutils [None req-6dbe7cc3-5e86-4141-8a4c-a652dc1066c9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:18.713700 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG oslo_concurrency.lockutils [None req-6dbe7cc3-5e86-4141-8a4c-a652dc1066c9 admin admin] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:18.714130 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG oslo_concurrency.lockutils [None req-6dbe7cc3-5e86-4141-8a4c-a652dc1066c9 admin admin] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:18.740298 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-6dbe7cc3-5e86-4141-8a4c-a652dc1066c9 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.090795 Aug 01 14:18:18.740914 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 38/74] 10.222.0.17 () {60 vars in 1193 bytes} [Mon Aug 1 14:18:18 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:18:19.588245 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-8ae8d743-0ac8-43ad-a0f5-bf3db3a1e952 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:19.589266 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-8ae8d743-0ac8-43ad-a0f5-bf3db3a1e952 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Aug 01 14:18:19.589672 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 37/75] 10.222.0.17 () {56 vars in 1074 bytes} [Mon Aug 1 14:18:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:18:19.836184 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG nova.api.openstack.wsgi [None req-192c4219-0654-446b-90b7-1cc9c98c2d1a admin admin] Calling method '>' {{(pid=103536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:19.838854 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:18:19.838854 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: warnings.warn(msg) Aug 01 14:18:19.840362 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG oslo_concurrency.lockutils [None req-192c4219-0654-446b-90b7-1cc9c98c2d1a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:19.840809 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG oslo_concurrency.lockutils [None req-192c4219-0654-446b-90b7-1cc9c98c2d1a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:19.841601 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG oslo_concurrency.lockutils [None req-192c4219-0654-446b-90b7-1cc9c98c2d1a admin admin] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:19.842033 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: DEBUG oslo_concurrency.lockutils [None req-192c4219-0654-446b-90b7-1cc9c98c2d1a admin admin] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:19.865791 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: INFO nova.api.openstack.requestlog [None req-192c4219-0654-446b-90b7-1cc9c98c2d1a admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.088035 Aug 01 14:18:19.866369 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: [pid: 103536|app: 0|req: 39/76] 10.222.0.17 () {60 vars in 1193 bytes} [Mon Aug 1 14:18:19 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:19:20.025678 dv-cinder-845990-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 01 14:19:20.026374 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: Mon Aug 1 14:19:20 2022 - graceful shutdown triggered... Aug 01 14:19:20.026918 dv-cinder-845990-5-iscsi devstack@n-api.service[103536]: Gracefully killing worker 1 (pid: 103536)... Aug 01 14:19:20.027310 dv-cinder-845990-5-iscsi devstack@n-api.service[103537]: Gracefully killing worker 2 (pid: 103537)... Aug 01 14:19:21.027317 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: worker 1 buried after 1 seconds Aug 01 14:19:21.027317 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: worker 2 buried after 1 seconds Aug 01 14:19:21.027317 dv-cinder-845990-5-iscsi devstack@n-api.service[103535]: goodbye to uWSGI. Aug 01 14:19:21.028926 dv-cinder-845990-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 01 14:19:21.029484 dv-cinder-845990-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 01 14:19:21.032381 dv-cinder-845990-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 01 14:19:21.043378 dv-cinder-845990-5-iscsi devstack@n-api.service[118114]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 01 14:19:21.045478 dv-cinder-845990-5-iscsi devstack@n-api.service[118114]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 14:19:21 2022] *** Aug 01 14:19:21.045478 dv-cinder-845990-5-iscsi devstack@n-api.service[118114]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 14:19:21.045478 dv-cinder-845990-5-iscsi devstack@n-api.service[118114]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 14:19:21.045478 dv-cinder-845990-5-iscsi devstack@n-api.service[118114]: nodename: dv-cinder-845990-5-iscsi Aug 01 14:19:21.045478 dv-cinder-845990-5-iscsi devstack@n-api.service[118114]: machine: x86_64 Aug 01 14:19:21.045478 dv-cinder-845990-5-iscsi devstack@n-api.service[118114]: clock source: unix Aug 01 14:19:21.045478 dv-cinder-845990-5-iscsi devstack@n-api.service[118114]: pcre jit disabled Aug 01 14:19:21.045478 dv-cinder-845990-5-iscsi devstack@n-api.service[118114]: detected number of CPU cores: 4 Aug 01 14:19:21.045478 dv-cinder-845990-5-iscsi devstack@n-api.service[118114]: current working directory: / Aug 01 14:19:21.045478 dv-cinder-845990-5-iscsi devstack@n-api.service[118114]: detected binary path: /usr/bin/uwsgi-core Aug 01 14:19:21.045478 dv-cinder-845990-5-iscsi devstack@n-api.service[118114]: your processes number limit is 47680 Aug 01 14:19:21.045478 dv-cinder-845990-5-iscsi devstack@n-api.service[118114]: your memory page size is 4096 bytes Aug 01 14:19:21.045478 dv-cinder-845990-5-iscsi devstack@n-api.service[118114]: detected max file descriptor number: 2048 Aug 01 14:19:21.045478 dv-cinder-845990-5-iscsi devstack@n-api.service[118114]: lock engine: pthread robust mutexes Aug 01 14:19:21.047285 dv-cinder-845990-5-iscsi devstack@n-api.service[118114]: thunder lock: enabled Aug 01 14:19:21.047285 dv-cinder-845990-5-iscsi devstack@n-api.service[118114]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 01 14:19:21.047285 dv-cinder-845990-5-iscsi devstack@n-api.service[118114]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 14:19:21.091623 dv-cinder-845990-5-iscsi devstack@n-api.service[118114]: Python main interpreter initialized at 0x55c93b8079c0 Aug 01 14:19:21.091623 dv-cinder-845990-5-iscsi devstack@n-api.service[118114]: python threads support enabled Aug 01 14:19:21.091623 dv-cinder-845990-5-iscsi devstack@n-api.service[118114]: your server socket listen backlog is limited to 100 connections Aug 01 14:19:21.091623 dv-cinder-845990-5-iscsi devstack@n-api.service[118114]: your mercy for graceful operations on workers is 90 seconds Aug 01 14:19:21.092059 dv-cinder-845990-5-iscsi devstack@n-api.service[118114]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 14:19:21.092059 dv-cinder-845990-5-iscsi devstack@n-api.service[118114]: *** Operational MODE: preforking *** Aug 01 14:19:21.092375 dv-cinder-845990-5-iscsi devstack@n-api.service[118114]: *** uWSGI is running in multiple interpreter mode *** Aug 01 14:19:21.092375 dv-cinder-845990-5-iscsi devstack@n-api.service[118114]: spawned uWSGI master process (pid: 118114) Aug 01 14:19:21.092617 dv-cinder-845990-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 01 14:19:21.092858 dv-cinder-845990-5-iscsi devstack@n-api.service[118114]: spawned uWSGI worker 1 (pid: 118132, cores: 1) Aug 01 14:19:21.093189 dv-cinder-845990-5-iscsi devstack@n-api.service[118114]: spawned uWSGI worker 2 (pid: 118133, cores: 1) Aug 01 14:19:21.093472 dv-cinder-845990-5-iscsi devstack@n-api.service[118114]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 14:19:21.800695 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 14:19:21.817478 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 14:19:23.050760 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:19:23.050760 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: from cryptography.utils import int_from_bytes Aug 01 14:19:23.051922 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:19:23.051922 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: from cryptography.utils import int_from_bytes Aug 01 14:19:23.052178 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:19:23.052178 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: from cryptography.utils import int_from_bytes Aug 01 14:19:23.052178 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:19:23.052178 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: from cryptography.utils import int_from_bytes Aug 01 14:19:25.537155 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 14:19:25.537873 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 14:19:25.538002 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 14:19:25.538309 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 14:19:25.538563 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 14:19:25.539547 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.539874 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.540192 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.540511 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.540842 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.541151 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.541475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.541796 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.542122 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.542382 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.542697 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.543029 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845990-5-iscsi {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.543355 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.543893 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.544210 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.544533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.544837 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.545162 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.545495 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.546011 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.546457 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.546766 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.547076 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.547419 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.547760 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.548088 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.548401 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.548712 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.549043 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.549597 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.549790 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845990-5-iscsi {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.550128 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.550442 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.550759 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.551211 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.551531 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.551847 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.552170 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.552743 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.553248 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.553775 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.554326 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.554850 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.555384 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.555918 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.556712 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.557221 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.557739 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.558055 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.558370 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.558634 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.559105 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.559273 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.559623 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.559955 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.560212 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.560690 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.560809 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.561096 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.561407 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.561716 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.562032 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.562334 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.562641 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.562947 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.563254 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.563586 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.563910 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.564227 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.564553 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.564859 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.565177 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.565593 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.565841 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.566147 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.566491 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.566808 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.567116 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.567439 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.567784 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.568089 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.568394 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.568702 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.569025 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.569359 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.569664 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.569917 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.570784 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.571089 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.571408 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.571740 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.572046 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.572352 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.572652 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.572957 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.573260 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.573565 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.573870 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.574174 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.574479 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.574798 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.575084 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.575387 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.575740 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.576069 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.576371 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 14:19:25.576888 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.577051 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 14:19:25.577209 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.577209 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.577534 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 14:19:25.577697 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.577870 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 14:19:25.578019 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.578192 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 14:19:25.578703 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.578859 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.579034 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.579197 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.579352 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.579536 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.579705 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.579944 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.580109 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.580263 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.580415 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.580569 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.580728 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.580874 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.581025 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.581178 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.581325 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.581482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.581628 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.581773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.581925 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.582095 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.582241 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.582401 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845990-5-iscsi {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.582548 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.582692 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.582847 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.582847 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.583123 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.583282 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.583430 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.583654 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.583802 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.583964 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.584117 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.584271 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.584429 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.584582 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.584727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.584898 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.584898 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.585304 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.585472 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.586247 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.586472 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.586634 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.586794 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.586949 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.587101 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.587254 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.587400 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.587590 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.587738 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.587890 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.588041 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.588187 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.588187 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.588928 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.589084 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.589237 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.589383 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.589535 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.589535 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.589838 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845990-5-iscsi {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.590090 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.590243 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.590395 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.590541 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.590697 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.590860 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.591567 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.591728 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.591876 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.592035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.592035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.592311 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.592471 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.592625 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.592778 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.592950 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.593104 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.593256 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.593423 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.593568 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.593718 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.593945 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.594148 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.594323 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.594323 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.594613 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.594766 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.594922 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.594922 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.595382 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.595616 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.595849 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.596024 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.596172 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.596324 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.596469 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.596676 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.596826 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.596992 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.597141 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.597293 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.597445 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.597601 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.598028 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.598200 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.598348 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.598492 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.598664 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.599162 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.599162 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.599486 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.599764 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.599915 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.600079 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.600323 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.600499 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.600646 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.600797 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.600942 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.601093 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.601239 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.601399 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.601399 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.601682 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.601828 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.601971 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.602125 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.602272 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.602428 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.602572 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.602730 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.602894 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.603050 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.603195 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.603348 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.603543 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.603707 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.603859 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.603859 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.604152 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.604308 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.604454 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.604598 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.604741 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.604894 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.605039 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.605183 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.605346 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.605599 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.605758 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.605912 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.606058 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.606208 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.606370 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.606523 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.606731 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.606882 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.607035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.607190 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.607342 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.607576 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.607746 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.607904 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.608056 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.608215 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.608361 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.608521 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.608676 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.608839 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.609293 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.609448 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.609602 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.609602 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.610034 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.610034 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.610334 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.610334 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.610710 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.610871 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.611038 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.611191 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.611336 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.611531 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.611763 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.611937 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.612085 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.612230 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.612375 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.612519 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.612734 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.612903 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.613060 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.613252 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.613449 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.613607 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.613754 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.613907 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.614067 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.614214 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.614367 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.614512 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.614656 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.614809 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.614966 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.615129 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.615281 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.615436 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.615636 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.616023 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.616268 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.616443 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.616612 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.616855 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.617009 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.617009 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.617331 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.617490 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.617688 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.617849 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.617849 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.618134 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.618287 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.618441 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.618601 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.618754 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.618899 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.618899 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.619601 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.619768 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.619924 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.619924 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.620413 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.620413 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.620835 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.620835 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.621157 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.621157 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.621446 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.621446 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.621737 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.621897 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.622050 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.622206 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.622365 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.622365 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.622646 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.622887 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.623044 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.623198 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.623345 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.623509 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.623661 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.623661 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.623961 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.624108 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.624273 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.624428 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.624428 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.624712 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.624865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.625019 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.625329 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.625329 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.625645 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.625792 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.625792 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.626199 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.626360 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:25.626518 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.626673 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.626673 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.627014 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.627161 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.627161 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.627443 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.627661 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.627818 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.627971 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.628118 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.628269 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.628415 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.628580 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.628727 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.628879 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.629024 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.629176 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.629176 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.629819 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.629973 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.630126 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.630290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.630548 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.630742 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.630989 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.631150 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.631295 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.631440 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.631622 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.631782 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.631929 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.632082 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.632303 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.632994 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.633155 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.633312 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.633473 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.633643 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.633799 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.633945 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.634102 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.634249 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.634393 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.634538 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.634682 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.634835 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.634995 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.635142 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.635294 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.635440 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.635621 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.635766 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.635930 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.636084 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.636344 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.636505 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.636659 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.636804 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.637007 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.637158 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.637311 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.637457 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.637602 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.637774 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.637922 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.638073 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.638266 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.638435 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.638590 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.638751 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.638905 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.639058 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.639204 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.639349 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.639530 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.640034 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.640201 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.640349 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.640494 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.640769 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.640930 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.641204 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.641355 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.641499 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.641644 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.641796 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.641957 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.642105 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.642262 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.642407 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.642560 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.642713 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.642867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.643033 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.643182 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.643334 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.643509 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.643674 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.643830 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.643977 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.644246 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.644409 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.644556 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.644708 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.644867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.645020 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.645166 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.645320 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.645466 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.645466 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.645827 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.645827 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.645827 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.645827 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.645827 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.645827 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.645827 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.645827 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.647129 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.647129 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.647129 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.647129 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.647129 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.647129 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.647129 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.647129 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.648838 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.648838 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.648838 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.648838 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.649510 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.649694 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.650079 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.650267 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.650267 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.650664 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.650946 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.651107 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.651373 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.651569 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.651720 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.651873 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.652028 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.652173 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.652327 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.652481 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.652665 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.652815 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.652975 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.653133 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.653294 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.653441 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.653611 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.653765 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.653911 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.653911 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.654201 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.654355 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.654501 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.654654 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.654801 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.655034 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.655184 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.655330 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.655493 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.655657 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.655816 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.655978 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.656125 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.656277 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.656423 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.656716 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.656870 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.657025 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.657285 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.657445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.657599 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.657754 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.657919 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.658080 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.658227 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.658427 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.658593 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.658741 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.658741 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.658741 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.658741 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.658741 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.658741 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.658741 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.658741 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.659901 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.659901 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.659901 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.659901 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.659901 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.659901 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.659901 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.659901 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.661684 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.661684 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.661684 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.661684 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.662862 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.663243 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.663400 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.663701 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.663857 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.664003 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.664158 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.664312 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.664457 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.664611 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.664765 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.664912 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.665077 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.665225 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.665225 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.665523 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.665677 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.665831 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.665984 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.666139 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.666293 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.666459 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.666614 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.666904 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.667058 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.667280 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.667449 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.667621 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.667767 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.667767 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.668052 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.668205 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.668360 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.668506 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.668659 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.668659 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.668948 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.669094 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.669263 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.669411 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.669563 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.669709 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.669863 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.670017 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.670183 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.670557 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.670718 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.670892 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.671187 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.671660 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.671821 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.671980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.672127 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.672291 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.672447 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.672602 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.672749 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.672749 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.673036 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.673191 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.673345 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.673500 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.673647 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.673811 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.674050 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.674209 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.674364 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.674520 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.674668 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.674820 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.674980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.675141 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.675288 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.675434 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.675604 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.675765 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.675936 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.676090 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.676236 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.676382 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.676382 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.676656 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.676812 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.677097 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.677260 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.677463 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.677621 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.677621 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.677916 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.678072 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.678218 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.678364 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.678517 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.678673 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.678820 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.678975 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.679121 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.679266 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.679542 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.679719 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.679868 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.680014 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.680170 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.680315 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.680489 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.680928 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.681089 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.681386 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.681691 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.681944 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.682107 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.682256 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.682409 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.682563 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.682723 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.682885 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.683050 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.683205 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.683351 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.683526 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.683686 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.683849 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.684017 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.684172 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.684331 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.684492 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.684646 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.684853 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.685020 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.685174 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.685327 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.685478 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.685630 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.685795 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.685949 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.686101 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.686260 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.686260 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.686565 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.686730 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.686894 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.687063 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.687346 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.687564 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.687734 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.687901 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.688055 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.688207 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.688360 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.688511 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.688670 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.688832 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.688992 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.689161 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.689323 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.689486 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.689653 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.689815 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.689974 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.690126 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.690286 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.690439 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.690601 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.690988 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.691150 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.691316 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.691666 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.691966 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.692230 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.692389 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.692560 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.692724 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.692891 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.693056 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.693211 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.693370 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.693524 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.696602 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.696829 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.697003 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.697172 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.697360 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.697523 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.697755 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.697912 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.698074 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.698228 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.698381 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.698533 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.698707 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.698871 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.699046 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.699201 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.699361 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.699551 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.699723 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.700000 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.700172 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.700333 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.700487 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.700648 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.700803 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.701202 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.701394 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.701570 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.701724 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.701889 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.702334 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.702504 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.702680 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.702839 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.702998 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.703165 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.703327 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.703613 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.703777 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.703953 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.704118 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.704273 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.704434 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.704434 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.704434 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.704861 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.705024 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.705177 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.705329 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.705482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.705634 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.705796 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.705974 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.706131 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.706284 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.706443 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.706603 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.706756 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.706923 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.707091 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.707253 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.707407 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.707586 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.707802 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.707802 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.708118 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.708273 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.708424 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.708424 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.708727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.708881 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.709041 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.709196 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.709196 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.709492 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.709655 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.709655 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.709944 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.710234 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.710234 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.710532 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.710764 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.710764 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.711086 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.711434 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.711434 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.712296 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.712645 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.712645 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.712999 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.713165 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.713165 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.713472 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.713644 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.713906 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.714063 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.714063 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.714360 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.714527 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.714527 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.714527 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.714973 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.715127 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.715127 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.715596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.715759 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.715759 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.716057 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.716208 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.716376 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.716538 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.716538 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.716839 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.716992 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.716992 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.717301 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.717469 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.717469 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.717758 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.717970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.717970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.718281 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.718441 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.718441 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.718737 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.718890 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.719041 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.719205 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.719205 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.719543 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.719704 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.719704 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.720001 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.720168 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.720168 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.720591 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.720690 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.720690 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.720857 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.720994 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.721096 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.721184 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.721184 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.721365 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.721621 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.721621 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.721621 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.721871 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.722010 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.722010 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.722237 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.722358 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.722358 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.723047 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.723184 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.723184 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.723408 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.723544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.723672 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.723787 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.723787 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.724152 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.724277 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.724277 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.724499 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.724613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.724613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.724613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.724613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.724613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.724613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.724613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.725344 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.725466 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.725466 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.725781 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.725898 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.725898 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.726115 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.726282 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.726411 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.726533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.726533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.726760 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.726883 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.727004 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.727127 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.727246 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.727365 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.727563 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.727704 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.727704 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.727704 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.728088 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.728200 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.728311 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.728432 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.728546 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.728658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.728770 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.728888 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.729015 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.729129 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.729241 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.729352 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.729471 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.729584 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.729709 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.729823 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.729823 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.730038 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.730157 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.730278 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.730701 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.730828 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.730942 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.731054 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.731166 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.731166 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.731385 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.731517 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.731763 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.731893 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.732012 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.732124 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.732245 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.732366 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.732480 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.732604 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.732726 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.732848 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.732975 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.733322 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.733443 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.733556 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.733668 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.733796 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.733957 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.734080 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.734336 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.734457 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.734585 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.734715 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.734915 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.735031 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.735174 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.735307 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.735577 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.735746 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.735901 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.736065 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.736218 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.736381 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.736674 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.736841 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.736996 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.737292 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.737451 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.737619 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.737911 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.738125 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.738362 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.738545 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.738714 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.738877 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.739061 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.739229 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.739419 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.739658 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.739841 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.740097 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.740256 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.740408 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.740824 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.740992 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.741159 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.741355 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.741515 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.741675 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.741976 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.742143 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.742307 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.742552 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.742713 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.742912 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.743133 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.743544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.743544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.743874 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.744029 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.744181 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.744359 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.744659 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.744827 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.745000 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.745321 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.745483 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.745642 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.745951 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.746118 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.746272 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.746566 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.746879 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.747075 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.747250 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.747594 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.747765 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.747931 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.748137 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.748313 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.748467 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.748867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.749048 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.749212 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.749367 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.749550 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.749815 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.749977 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.750147 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.750322 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.750543 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.750743 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.751178 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.751356 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.751797 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.752237 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.752535 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.752535 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.753003 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.753229 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.753229 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.753967 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.754140 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.754140 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.754489 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.754668 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.754668 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.755117 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.755282 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.755282 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.755615 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.755770 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.755934 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.756418 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.756621 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.756836 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.757071 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.757360 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.758278 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.758278 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.758603 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.758767 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.758948 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.759196 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.759356 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.759641 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.759820 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.760095 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.760255 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.760452 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.760754 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.760923 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.761097 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.761374 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.761540 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.761696 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.762015 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.762205 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.762468 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.762654 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.762809 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.762961 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.763212 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.763383 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.763871 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.764047 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.764202 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.764366 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.764535 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.764689 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.764851 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.765142 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.765320 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.765485 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.765640 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.765803 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.765958 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.766110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.766268 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.766437 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.766599 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.766761 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.766916 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.767075 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.767246 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.767409 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.767651 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.767814 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.767977 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.768139 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.768449 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.768621 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.768783 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.768945 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.769106 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.769381 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.769558 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.769724 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.769877 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.770031 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.770183 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.770335 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.770502 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.770656 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.770808 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.770968 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.771122 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.771274 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.771568 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.771737 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.771902 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.772063 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.772217 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.772369 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.772703 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.772866 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.773019 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.773749 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.774100 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.774274 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.774430 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.774583 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.774736 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.774908 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.774908 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.775322 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.775502 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.775674 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.775839 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.776041 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.776200 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.776396 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.776563 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.777317 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.777499 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.777655 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.777807 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.777967 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.778126 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.778289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.778572 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.778747 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.778909 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.779063 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.779265 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.779562 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.779724 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.779898 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.780060 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.780060 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.780366 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.780530 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.780684 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.780684 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.780981 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.780981 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.781279 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.781433 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.781706 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.781886 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.782041 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.782204 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.782368 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.782521 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.782792 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.782961 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.783131 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.783131 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.783431 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.783695 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.783851 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.784011 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.784399 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.784553 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.784716 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.784869 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.785028 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.785181 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.785351 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.785634 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.785804 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.785966 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.786126 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.786287 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.786447 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.786622 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.786783 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.786945 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.787105 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.787265 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.787426 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.787619 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.787781 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.787936 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.788102 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.788256 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.788421 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.788778 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.788778 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.789090 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.789090 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.789381 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.789561 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.789811 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.790197 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.790300 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.790385 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.790480 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.790576 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.790673 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.790760 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.790854 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.790941 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.791027 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.791124 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.791219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.791355 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.791468 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.791608 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.791853 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.791981 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.792095 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.792221 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.792343 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.792532 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.792677 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.792798 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.792798 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.792798 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.792798 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.793122 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.793230 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.793319 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.793404 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.793491 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.793575 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.793674 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.793761 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.793847 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.793930 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.794016 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.794099 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.794219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.794501 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.794601 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.794688 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.794781 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.794867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.794967 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.795054 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.795147 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.795241 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.795336 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.795434 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.795632 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.795776 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.795776 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.795953 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.796048 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.796149 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.796251 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.796340 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.796425 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.796510 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.796734 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.796841 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.797043 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.797139 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.797359 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.797486 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.797670 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.797787 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.797980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.798083 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.798297 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.798397 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.798607 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.798788 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.798923 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.799020 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.799243 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.799336 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.799665 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.799781 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.799987 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.800094 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.800296 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.800397 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.800602 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.800705 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.800909 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.801011 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.801218 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.801394 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.801524 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.801626 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.802016 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.802130 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.802219 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.802305 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.802431 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.802541 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.802733 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.802841 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.803041 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.803145 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.803351 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.803446 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.803681 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.803786 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.803988 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.804091 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.804309 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.804422 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.804670 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.804779 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.804912 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.805008 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.805224 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.805318 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.805536 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.805629 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.805858 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.806005 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.806180 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.807185 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.807478 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.807657 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.807657 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.807905 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.808008 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.808096 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.808246 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.808344 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.808344 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.808508 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.808603 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.808697 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.808779 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.808779 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.809306 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.809754 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.810031 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.810177 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.810269 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.810371 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.810461 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.810554 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.810647 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.810749 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.810847 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.810943 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.811030 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.811115 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.811201 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.811286 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.811385 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.811553 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.811644 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.811743 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.811839 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.811986 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.812121 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.812311 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.812427 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.812624 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.812727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.812937 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.813051 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.813263 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.813370 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.813569 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.813886 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.814040 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.814134 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.814227 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.814501 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.814878 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.814978 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.815068 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.815207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.815291 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.815372 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.815445 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.815696 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.815798 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.816100 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.816319 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.816622 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.816934 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.817029 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.817241 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.817324 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.817542 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.817623 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.817844 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.817943 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.818195 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.818285 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.818504 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.818593 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.818804 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.818899 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.819110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.819194 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.819409 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.819639 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.820535 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.820870 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.821192 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.821505 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.821606 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.821814 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.821922 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.822076 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 14:19:25.822216 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.822496 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.822827 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.823145 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.823478 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.824703 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.825019 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.825334 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.825653 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.825976 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.826294 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.826608 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.826918 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.827233 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.827623 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.827957 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.828267 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.828575 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.828899 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.829317 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.829645 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.829963 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.830276 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.830627 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.830945 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.831537 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.831876 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.832201 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.832540 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.832879 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.833188 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.833494 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.833802 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.834128 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.834440 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.834751 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.835122 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.835370 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.836318 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.836696 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.837010 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.837324 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.837638 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.837946 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.838257 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.838566 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.838881 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.839186 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.839557 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.839953 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.840219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.840533 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.840847 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.841161 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.841474 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.841784 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.842092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.842399 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.842711 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.843042 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.843356 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.843687 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.844113 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.844467 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.844742 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.845064 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.845373 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.845693 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.846015 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.846323 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.846663 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.846951 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.847278 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.847959 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.848226 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.848549 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.848853 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.849157 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.849460 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.849766 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.850088 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.850392 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.850693 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.850994 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.851330 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.851657 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.851972 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.852290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.852590 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.852903 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.853203 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.853503 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.853805 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.854103 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.854402 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.854706 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.855012 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.855304 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.855633 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.855937 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.856239 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.856536 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.856869 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.857199 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.857510 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.857829 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.858138 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.858456 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.858760 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.859079 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.859397 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.859742 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.860130 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.860380 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.860685 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.860992 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.861299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.861604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.861909 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.862212 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.862533 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.862859 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.863160 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.863536 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.863818 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.864133 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.864448 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.864749 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.865097 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.865384 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.865689 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.865993 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.866298 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.866603 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.866940 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.867245 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.867611 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.867904 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.868275 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.868618 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.868866 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.869170 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.869488 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.869840 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.870153 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.870461 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.870801 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.871124 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.871435 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.871768 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.872069 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:25.872308 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 14:19:25.884336 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO dbcounter [None req-726f34fa-55eb-43a1-bca3-8e535c717334 None None] Registered counter for database nova_api Aug 01 14:19:25.905509 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_db.sqlalchemy.engines [None req-726f34fa-55eb-43a1-bca3-8e535c717334 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118132) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:19:25.912188 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writer thread running {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:19:25.933980 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO dbcounter [None req-9c13c309-7bdc-443c-9c7f-40d55fcfb374 None None] Registered counter for database nova_api Aug 01 14:19:25.954733 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_db.sqlalchemy.engines [None req-9c13c309-7bdc-443c-9c7f-40d55fcfb374 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:19:25.961453 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writer thread running {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:19:25.968852 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.context [None req-726f34fa-55eb-43a1-bca3-8e535c717334 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9805e85f-ba25-403f-8805-6e956776eddb(cell1) {{(pid=118132) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 14:19:25.973261 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-726f34fa-55eb-43a1-bca3-8e535c717334 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:25.975255 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-726f34fa-55eb-43a1-bca3-8e535c717334 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:25.976068 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-726f34fa-55eb-43a1-bca3-8e535c717334 None None] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:25.978091 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-726f34fa-55eb-43a1-bca3-8e535c717334 None None] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:25.980083 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO dbcounter [None req-726f34fa-55eb-43a1-bca3-8e535c717334 None None] Registered counter for database nova_cell0 Aug 01 14:19:25.984122 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO dbcounter [None req-726f34fa-55eb-43a1-bca3-8e535c717334 None None] Registered counter for database nova_cell1 Aug 01 14:19:25.991420 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_db.sqlalchemy.engines [None req-726f34fa-55eb-43a1-bca3-8e535c717334 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118132) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:19:25.993350 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_db.sqlalchemy.engines [None req-726f34fa-55eb-43a1-bca3-8e535c717334 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118132) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:19:26.000732 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writer thread running {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:19:26.001068 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writer thread running {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:19:26.017862 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.context [None req-9c13c309-7bdc-443c-9c7f-40d55fcfb374 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9805e85f-ba25-403f-8805-6e956776eddb(cell1) {{(pid=118133) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 14:19:26.021988 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9c13c309-7bdc-443c-9c7f-40d55fcfb374 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:26.024150 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9c13c309-7bdc-443c-9c7f-40d55fcfb374 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:26.024930 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9c13c309-7bdc-443c-9c7f-40d55fcfb374 None None] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:26.026905 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9c13c309-7bdc-443c-9c7f-40d55fcfb374 None None] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:26.028913 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO dbcounter [None req-9c13c309-7bdc-443c-9c7f-40d55fcfb374 None None] Registered counter for database nova_cell0 Aug 01 14:19:26.032939 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO dbcounter [None req-9c13c309-7bdc-443c-9c7f-40d55fcfb374 None None] Registered counter for database nova_cell1 Aug 01 14:19:26.040354 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_db.sqlalchemy.engines [None req-9c13c309-7bdc-443c-9c7f-40d55fcfb374 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:19:26.042081 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_db.sqlalchemy.engines [None req-9c13c309-7bdc-443c-9c7f-40d55fcfb374 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:19:26.048433 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writer thread running {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:19:26.050462 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writer thread running {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:19:26.150538 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO dbcounter [None req-726f34fa-55eb-43a1-bca3-8e535c717334 None None] Registered counter for database nova_cell0 Aug 01 14:19:26.157292 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_db.sqlalchemy.engines [None req-726f34fa-55eb-43a1-bca3-8e535c717334 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118132) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:19:26.161684 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writer thread running {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:19:26.195923 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO dbcounter [None req-9c13c309-7bdc-443c-9c7f-40d55fcfb374 None None] Registered counter for database nova_cell0 Aug 01 14:19:26.203665 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_db.sqlalchemy.engines [None req-9c13c309-7bdc-443c-9c7f-40d55fcfb374 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:19:26.208456 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writer thread running {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:19:26.483858 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: WARNING keystonemiddleware.auth_token [None req-726f34fa-55eb-43a1-bca3-8e535c717334 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 14:19:26.491068 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: WARNING keystonemiddleware.auth_token [None req-726f34fa-55eb-43a1-bca3-8e535c717334 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 14:19:26.527549 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: WARNING keystonemiddleware.auth_token [None req-9c13c309-7bdc-443c-9c7f-40d55fcfb374 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 14:19:26.534846 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: WARNING keystonemiddleware.auth_token [None req-9c13c309-7bdc-443c-9c7f-40d55fcfb374 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 14:19:26.847208 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: WARNING keystonemiddleware.auth_token [None req-726f34fa-55eb-43a1-bca3-8e535c717334 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 14:19:26.855348 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: WARNING keystonemiddleware.auth_token [None req-726f34fa-55eb-43a1-bca3-8e535c717334 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 14:19:26.861221 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c93b8079c0 pid: 118132 (default app) Aug 01 14:19:26.887989 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: WARNING keystonemiddleware.auth_token [None req-9c13c309-7bdc-443c-9c7f-40d55fcfb374 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 14:19:26.894098 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: WARNING keystonemiddleware.auth_token [None req-9c13c309-7bdc-443c-9c7f-40d55fcfb374 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 14:19:26.900035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c93b8079c0 pid: 118133 (default app) Aug 01 14:20:09.123154 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=3 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:09.123984 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=3 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:09.125171 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=3 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:09.126588 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=3 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:10.628555 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-60b99a7c-a374-400e-8d28-fc06c0b119f8 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] Action: 'create', calling method: .version_select at 0x7f6187486f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-148858853"}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:20:12.652642 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-60b99a7c-a374-400e-8d28-fc06c0b119f8 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.544920 Aug 01 14:20:12.653321 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 1/1] 10.222.0.17 () {60 vars in 1155 bytes} [Mon Aug 1 14:20:09 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3547 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 01 14:20:12.671339 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-bdedb2d1-9b5c-413a-b895-e5cbd16f8ed2 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] Calling method '.version_select at 0x7f6187308dc0>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:12.829288 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-bdedb2d1-9b5c-413a-b895-e5cbd16f8ed2 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/d6ac4ee2-8b80-4d6d-99b9-0023e5012405" status: 200 len: 344 microversion: 2.1 time: 0.162443 Aug 01 14:20:12.836108 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 2/2] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Aug 1 14:20:12 2022] GET /compute/v2.1/os-volumes/d6ac4ee2-8b80-4d6d-99b9-0023e5012405 => generated 344 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:13.126555 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-dcf6df40-728c-442b-b4e4-5fcafd228463 tempest-VolumesTestJSON-1762280700 tempest-VolumesTestJSON-1762280700-project] Calling method '.version_select at 0x7f6187563a60>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:13.176521 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=3 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:13.184198 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=3 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:13.186251 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=3 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:13.187491 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=3 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:13.846095 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c366465f-ae52-4e85-be89-d4762d75ebb0 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] Calling method '.version_select at 0x7f61873194c0>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:13.949719 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-dcf6df40-728c-442b-b4e4-5fcafd228463 tempest-VolumesTestJSON-1762280700 tempest-VolumesTestJSON-1762280700-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/997943c7-161b-4548-887e-626be5d90994" status: 200 len: 350 microversion: 2.1 time: 1.293061 Aug 01 14:20:13.951058 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 1/3] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Aug 1 14:20:12 2022] GET /compute/v2.1/os-volumes/997943c7-161b-4548-887e-626be5d90994 => generated 350 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:20:14.503396 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c366465f-ae52-4e85-be89-d4762d75ebb0 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/d6ac4ee2-8b80-4d6d-99b9-0023e5012405" status: 200 len: 345 microversion: 2.1 time: 0.662897 Aug 01 14:20:14.503957 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 3/4] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Aug 1 14:20:13 2022] GET /compute/v2.1/os-volumes/d6ac4ee2-8b80-4d6d-99b9-0023e5012405 => generated 345 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:14.516980 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-bde08e60-3c56-4c9a-b248-a2143f7099c5 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] Action: 'create', calling method: .version_select at 0x7f61873b7d30>, body: {"snapshot": {"volume_id": "d6ac4ee2-8b80-4d6d-99b9-0023e5012405", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1937280017"}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:20:15.159811 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-bde08e60-3c56-4c9a-b248-a2143f7099c5 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.646849 Aug 01 14:20:15.160631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 2/5] 10.222.0.17 () {60 vars in 1162 bytes} [Mon Aug 1 14:20:14 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:15.171407 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-fa142ca7-c296-47c2-b690-a0c8d40f5e3c tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] Calling method '.version_select at 0x7f6187319b80>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:15.504595 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-fa142ca7-c296-47c2-b690-a0c8d40f5e3c tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/b8aca42d-80e2-442c-bd36-790e3fbd4857" status: 200 len: 287 microversion: 2.1 time: 0.336823 Aug 01 14:20:15.513056 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 4/6] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Aug 1 14:20:15 2022] GET /compute/v2.1/os-snapshots/b8aca42d-80e2-442c-bd36-790e3fbd4857 => generated 287 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:15.518303 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-cd8dca98-6237-42d0-9fd3-bbb95e2d761a tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] Calling method '.version_select at 0x7f6187379af0>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:15.891891 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-cd8dca98-6237-42d0-9fd3-bbb95e2d761a tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.376992 Aug 01 14:20:15.892963 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 3/7] 10.222.0.17 () {58 vars in 1140 bytes} [Mon Aug 1 14:20:15 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:15.904219 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5cef56a9-6e2d-4355-88d1-d7558d0153f6 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] Calling method '.version_select at 0x7f6187308ca0>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:15.956654 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5cef56a9-6e2d-4355-88d1-d7558d0153f6 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/b8aca42d-80e2-442c-bd36-790e3fbd4857" status: 200 len: 287 microversion: 2.1 time: 0.056596 Aug 01 14:20:15.957501 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 5/8] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Aug 1 14:20:15 2022] GET /compute/v2.1/os-snapshots/b8aca42d-80e2-442c-bd36-790e3fbd4857 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:16.970253 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-2c3c2cfb-2507-47c6-ba75-7f4867918b9b tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] Calling method '.version_select at 0x7f61873799d0>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:17.095233 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-2c3c2cfb-2507-47c6-ba75-7f4867918b9b tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/b8aca42d-80e2-442c-bd36-790e3fbd4857" status: 200 len: 287 microversion: 2.1 time: 0.129203 Aug 01 14:20:17.096253 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 4/9] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Aug 1 14:20:16 2022] GET /compute/v2.1/os-snapshots/b8aca42d-80e2-442c-bd36-790e3fbd4857 => generated 287 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:18.108334 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c2d5ce9a-fa65-484f-8da9-052090d4d590 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] Calling method '.version_select at 0x7f6187319940>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:18.173192 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c2d5ce9a-fa65-484f-8da9-052090d4d590 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/b8aca42d-80e2-442c-bd36-790e3fbd4857" status: 200 len: 287 microversion: 2.1 time: 0.068628 Aug 01 14:20:18.179423 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 6/10] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Aug 1 14:20:18 2022] GET /compute/v2.1/os-snapshots/b8aca42d-80e2-442c-bd36-790e3fbd4857 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:19.196322 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9c6e285a-6b36-44bc-9bc6-185e25baab1e tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] Calling method '.version_select at 0x7f61873149d0>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:19.265231 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9c6e285a-6b36-44bc-9bc6-185e25baab1e tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/b8aca42d-80e2-442c-bd36-790e3fbd4857" status: 200 len: 288 microversion: 2.1 time: 0.077891 Aug 01 14:20:19.266063 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 5/11] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Aug 1 14:20:19 2022] GET /compute/v2.1/os-snapshots/b8aca42d-80e2-442c-bd36-790e3fbd4857 => generated 288 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:19.282432 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c210d633-48d8-4570-9c92-3f049aa797ba tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] Calling method '.version_select at 0x7f6187319280>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:19.443799 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c210d633-48d8-4570-9c92-3f049aa797ba tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/b8aca42d-80e2-442c-bd36-790e3fbd4857" status: 202 len: 0 microversion: 2.1 time: 0.169281 Aug 01 14:20:19.447295 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 7/12] 10.222.0.17 () {58 vars in 1254 bytes} [Mon Aug 1 14:20:19 2022] DELETE /compute/v2.1/os-snapshots/b8aca42d-80e2-442c-bd36-790e3fbd4857 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:20:19.452827 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-63d79951-0437-4455-806b-d02fcabe94ff tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] Calling method '.version_select at 0x7f6187314430>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:19.515139 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-63d79951-0437-4455-806b-d02fcabe94ff tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/b8aca42d-80e2-442c-bd36-790e3fbd4857" status: 200 len: 287 microversion: 2.1 time: 0.066434 Aug 01 14:20:19.516593 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 6/13] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Aug 1 14:20:19 2022] GET /compute/v2.1/os-snapshots/b8aca42d-80e2-442c-bd36-790e3fbd4857 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:20.161192 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-920c3710-fbe6-4cce-bc2e-8492fe8044d8 tempest-VolumesTestJSON-1762280700 tempest-VolumesTestJSON-1762280700-project] Calling method '.version_select at 0x7f6187308dc0>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:20.298905 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-920c3710-fbe6-4cce-bc2e-8492fe8044d8 tempest-VolumesTestJSON-1762280700 tempest-VolumesTestJSON-1762280700-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/2835f7e3-985e-403e-9b78-57474e611848" status: 200 len: 351 microversion: 2.1 time: 0.141325 Aug 01 14:20:20.300235 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 8/14] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Aug 1 14:20:20 2022] GET /compute/v2.1/os-volumes/2835f7e3-985e-403e-9b78-57474e611848 => generated 351 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:20.528350 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6d8d75a7-58b2-49ed-8b3d-9667cd231a37 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] Calling method '.version_select at 0x7f6187b5c820>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:20.977117 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-6d8d75a7-58b2-49ed-8b3d-9667cd231a37 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] HTTP exception thrown: Snapshot b8aca42d-80e2-442c-bd36-790e3fbd4857 could not be found. Aug 01 14:20:20.987646 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6d8d75a7-58b2-49ed-8b3d-9667cd231a37 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] Request method failure captured: Aug 01 14:20:20.987646 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/os-snapshots/b8aca42d-80e2-442c-bd36-790e3fbd4857 HTTP/1.1 Aug 01 14:20:20.987646 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:20:20.987646 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:20:20.987646 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:20:20.987646 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 0 Aug 01 14:20:20.987646 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:20:20.987646 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:20:20.987646 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:20:20.987646 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:20:20.987646 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-EZ96FtZONeVjGn97GQBV87e0hjxyXGhZMFZML1wFUyCsm1JNsKpPTBiIqLI-kE5icz5dsLBgPFlUy2HP7BpT91GBzqAoEgdTrY3m2WP-KIEPl8yUPbVjJEVaF5phTjWPU-lbDeomQXy-VvfrEU_2PpQ2yT5D3iKbca22i8Cw3syaA Aug 01 14:20:20.987646 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:20:20.987646 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:20:20.987646 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:20:20.987646 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:20:20.987646 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:20:20.987646 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:20:20.987646 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: a07d5eb233d349eab325368d9914f3e9 Aug 01 14:20:20.987646 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-267598988 Aug 01 14:20:20.987646 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:20:20.987646 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:20:20.989050 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a07d5eb233d349eab325368d9914f3e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a07d5eb233d349eab325368d9914f3e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a07d5eb233d349eab325368d9914f3e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a07d5eb233d349eab325368d9914f3e9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:20:20.989050 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-VolumesSnapshotsTestJSON-267598988 Aug 01 14:20:20.989050 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: a07d5eb233d349eab325368d9914f3e9 Aug 01 14:20:20.989050 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-267598988 Aug 01 14:20:20.989050 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-VolumesSnapshotsTestJSON-267598988-project Aug 01 14:20:20.989050 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:20:20.989050 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:20:20.989050 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: e47a94fa5e554608aadafdabadd901b9 Aug 01 14:20:20.989050 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-VolumesSnapshotsTestJSON-267598988-project Aug 01 14:20:20.989050 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: Aug 01 14:20:20.989050 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Snapshot b8aca42d-80e2-442c-bd36-790e3fbd4857 could not be found. Aug 01 14:20:20.989050 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'id': 'b8aca42d-80e2-442c-bd36-790e3fbd4857'} Aug 01 14:20:20.989050 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:20:20.990110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:20.990110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 01 14:20:20.990110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 01 14:20:20.990110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 01 14:20:20.990110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 01 14:20:20.990110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 01 14:20:20.990110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 01 14:20:20.990110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:20:20.990110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:20:20.990110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:20:20.990110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:20:20.990110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:20:20.990110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:20:20.990110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:20:20.990110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:20:20.990110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b8aca42d-80e2-442c-bd36-790e3fbd4857 could not be found. (HTTP 404) (Request-ID: req-d2ee24b3-1715-4a55-a3c3-171a1f476014) Aug 01 14:20:20.990110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:20:20.990110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:20:20.991575 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:20:20.991575 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:20.991575 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 01 14:20:20.991575 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 01 14:20:20.991575 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:20:20.991575 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:20:20.991575 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 01 14:20:20.991575 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 01 14:20:20.991575 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:20:20.991575 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:20:20.991575 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 01 14:20:20.991575 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 01 14:20:20.991575 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 01 14:20:20.991575 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 01 14:20:20.991575 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 01 14:20:20.991575 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 01 14:20:20.991575 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:20:20.991575 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:20:20.991575 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:20:20.993737 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:20:20.993737 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:20:20.993737 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:20:20.993737 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:20:20.993737 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:20:20.993737 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b8aca42d-80e2-442c-bd36-790e3fbd4857 could not be found. Aug 01 14:20:20.993737 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:20:20.993737 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:20:20.993737 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:20:20.993737 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:20.993737 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:20:20.993737 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:20:20.993737 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:20:20.993737 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:20:20.993737 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:20:20.993737 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:20:20.993737 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:20:20.993737 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:20:20.993737 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 01 14:20:20.993737 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:20:20.995132 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b8aca42d-80e2-442c-bd36-790e3fbd4857 could not be found. Aug 01 14:20:20.995132 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:20:20.995132 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:20:20.995132 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:20:20.995132 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:20.995132 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:20:20.995132 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:20:20.995132 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:20:20.995132 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:20:20.995132 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b8aca42d-80e2-442c-bd36-790e3fbd4857 could not be found. Aug 01 14:20:20.995132 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:20:20.998257 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6d8d75a7-58b2-49ed-8b3d-9667cd231a37 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] Returning 404 to user: Snapshot b8aca42d-80e2-442c-bd36-790e3fbd4857 could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:20:21.004701 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6d8d75a7-58b2-49ed-8b3d-9667cd231a37 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/b8aca42d-80e2-442c-bd36-790e3fbd4857" status: 404 len: 111 microversion: 2.1 time: 0.480363 Aug 01 14:20:21.010087 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 7/15] 10.222.0.17 () {58 vars in 1251 bytes} [Mon Aug 1 14:20:20 2022] GET /compute/v2.1/os-snapshots/b8aca42d-80e2-442c-bd36-790e3fbd4857 => generated 111 bytes in 484 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:20:21.049068 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c063df72-9069-4015-8d0d-ce3d2687669e tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] Calling method '.version_select at 0x7f6187b5c820>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:21.200624 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c063df72-9069-4015-8d0d-ce3d2687669e tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/d6ac4ee2-8b80-4d6d-99b9-0023e5012405" status: 202 len: 0 microversion: 2.1 time: 0.173363 Aug 01 14:20:21.201188 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 8/16] 10.222.0.17 () {58 vars in 1248 bytes} [Mon Aug 1 14:20:21 2022] DELETE /compute/v2.1/os-volumes/d6ac4ee2-8b80-4d6d-99b9-0023e5012405 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:20:21.212935 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5031c567-9870-48e3-b9a5-8a06ad585cbf tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] Calling method '.version_select at 0x7f6187379700>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:21.368083 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5031c567-9870-48e3-b9a5-8a06ad585cbf tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/d6ac4ee2-8b80-4d6d-99b9-0023e5012405" status: 200 len: 344 microversion: 2.1 time: 0.161823 Aug 01 14:20:21.368658 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 9/17] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Aug 1 14:20:21 2022] GET /compute/v2.1/os-volumes/d6ac4ee2-8b80-4d6d-99b9-0023e5012405 => generated 344 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:20:21.620388 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-bc7f6be3-aa4a-432e-84a7-f935350958cb tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Action: 'create', calling method: .version_select at 0x7f61873194c0>, body: {"keypair": {"name": "tempest-keypair-671634509", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNd3JYVYdN62Vt66uPiHevq2WQ/czN6jwMNzzPzzmg9x72ZHrXoylQruAVgqPgKq1EK8ercFc0AuBDXfBZZPS34tf/HNaPf0Sgsg9knlgpvw4ffgrZyKAbrx5hPdKzeug=="}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:20:21.785233 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-bc7f6be3-aa4a-432e-84a7-f935350958cb tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Getting quotas for project 3092982f3c6f4851a5a6e84bf7872d11. Resources: {'key_pairs'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:20:21.809218 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-bc7f6be3-aa4a-432e-84a7-f935350958cb tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Getting quotas for user 9eda4e19122444cf9cb2b6941adff9d5 and project 3092982f3c6f4851a5a6e84bf7872d11. Resources: {'key_pairs'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:20:21.855994 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7a869d38-40ad-40bf-a3fa-a2cfe74557e4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1689970816", "imageRef": "9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1", "flavorRef": "452", "networks": [{"uuid": "7ab048cd-c987-4038-9245-5d21591ec159"}]}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:20:21.910145 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-bc7f6be3-aa4a-432e-84a7-f935350958cb tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.115103 Aug 01 14:20:21.934352 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 9/18] 10.222.0.17 () {60 vars in 1159 bytes} [Mon Aug 1 14:20:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:22.109135 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.network.neutron [None req-7a869d38-40ad-40bf-a3fa-a2cfe74557e4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] validate_networks() for [('7ab048cd-c987-4038-9245-5d21591ec159', None, None, None, None, None)] {{(pid=118133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:20:22.383842 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-cdf800d2-649c-43ac-a52c-dc042133f828 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] Calling method '.version_select at 0x7f61872b1280>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:22.520020 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-cdf800d2-649c-43ac-a52c-dc042133f828 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/d6ac4ee2-8b80-4d6d-99b9-0023e5012405" status: 200 len: 344 microversion: 2.1 time: 0.141205 Aug 01 14:20:22.521619 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 10/19] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Aug 1 14:20:22 2022] GET /compute/v2.1/os-volumes/d6ac4ee2-8b80-4d6d-99b9-0023e5012405 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:23.534650 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8760ddcd-537c-4631-a301-ba76840b1953 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] Calling method '.version_select at 0x7f61872b1940>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:23.688313 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8760ddcd-537c-4631-a301-ba76840b1953 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/d6ac4ee2-8b80-4d6d-99b9-0023e5012405" status: 200 len: 344 microversion: 2.1 time: 0.157020 Aug 01 14:20:23.690104 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 11/20] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Aug 1 14:20:23 2022] GET /compute/v2.1/os-volumes/d6ac4ee2-8b80-4d6d-99b9-0023e5012405 => generated 344 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:20:24.100652 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-7a869d38-40ad-40bf-a3fa-a2cfe74557e4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Flavor limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:20:24.101652 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-7a869d38-40ad-40bf-a3fa-a2cfe74557e4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Image limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:20:24.102450 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-7a869d38-40ad-40bf-a3fa-a2cfe74557e4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Flavor pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:20:24.103034 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-7a869d38-40ad-40bf-a3fa-a2cfe74557e4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Image pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:20:24.103688 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-7a869d38-40ad-40bf-a3fa-a2cfe74557e4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:20:24.139347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7a869d38-40ad-40bf-a3fa-a2cfe74557e4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:24.140874 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7a869d38-40ad-40bf-a3fa-a2cfe74557e4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:24.141841 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7a869d38-40ad-40bf-a3fa-a2cfe74557e4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:24.142401 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7a869d38-40ad-40bf-a3fa-a2cfe74557e4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:24.221451 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-7a869d38-40ad-40bf-a3fa-a2cfe74557e4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Getting quotas for project b9f5632d6b304db99e66877b0c329714. Resources: {'instances', 'cores', 'ram'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:20:24.234885 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-7a869d38-40ad-40bf-a3fa-a2cfe74557e4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Getting quotas for user 67fcd16d046c4df2a5dc99b43262375a and project b9f5632d6b304db99e66877b0c329714. Resources: {'instances', 'cores', 'ram'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:20:24.270689 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7a869d38-40ad-40bf-a3fa-a2cfe74557e4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Going to run 1 instances... {{(pid=118133) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:20:24.274311 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7a869d38-40ad-40bf-a3fa-a2cfe74557e4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:20:24.537166 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7a869d38-40ad-40bf-a3fa-a2cfe74557e4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.807603 Aug 01 14:20:24.538383 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 10/21] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Aug 1 14:20:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 14:20:24.554996 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3c6ff5af-5825-4ec6-b8b4-f97af1c1d137 tempest-VolumesTestJSON-1762280700 tempest-VolumesTestJSON-1762280700-project] Calling method '.version_select at 0x7f61871f0af0>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:24.669305 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a4ffb0ee-7626-4bc2-a6e2-6fdb4bc24978 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Action: 'create', calling method: .version_select at 0x7f61872b1f70>, body: {"keypair": {"name": "tempest-keypair-1434419082", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIqbMrQ+TFqBl+emyIBJ+5C+BjvpZNnlm6uAfbeK70eNJVeVWQMgWKgCWSsRE4NbPanbTNX8x6KSpvFayc2Q2VwAkfhRkenowFIsJuaSXc1vn83Snaf2ghdFAKLUurenA=="}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:20:24.731997 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-a4ffb0ee-7626-4bc2-a6e2-6fdb4bc24978 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Getting quotas for project 2fb1590048254549bb480d677892031f. Resources: {'key_pairs'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:20:24.745497 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-a4ffb0ee-7626-4bc2-a6e2-6fdb4bc24978 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Getting quotas for user fbaa67d901e34419b1616a8457fbd683 and project 2fb1590048254549bb480d677892031f. Resources: {'key_pairs'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:20:24.802604 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a4ffb0ee-7626-4bc2-a6e2-6fdb4bc24978 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.665174 Aug 01 14:20:24.803768 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 12/22] 10.222.0.17 () {62 vars in 1200 bytes} [Mon Aug 1 14:20:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 667 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 01 14:20:24.816412 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2a70f069-572e-4fdc-8991-fbf189663e44 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:24.819359 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2a70f069-572e-4fdc-8991-fbf189663e44 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:24.833284 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3c6ff5af-5825-4ec6-b8b4-f97af1c1d137 tempest-VolumesTestJSON-1762280700 tempest-VolumesTestJSON-1762280700-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/6bb54ba1-c1fb-46b5-9a19-fedba44d487f" status: 200 len: 349 microversion: 2.1 time: 0.293474 Aug 01 14:20:24.834166 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 11/23] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Aug 1 14:20:24 2022] GET /compute/v2.1/os-volumes/6bb54ba1-c1fb-46b5-9a19-fedba44d487f => generated 349 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:24.842260 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-46cfe2e3-25e7-434e-b406-3b1a15ddea27 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] Calling method '.version_select at 0x7f618698e280>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:25.014186 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-46cfe2e3-25e7-434e-b406-3b1a15ddea27 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] HTTP exception thrown: Volume d6ac4ee2-8b80-4d6d-99b9-0023e5012405 could not be found. Aug 01 14:20:25.017482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-46cfe2e3-25e7-434e-b406-3b1a15ddea27 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] Request method failure captured: Aug 01 14:20:25.017482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/os-volumes/d6ac4ee2-8b80-4d6d-99b9-0023e5012405 HTTP/1.1 Aug 01 14:20:25.017482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:20:25.017482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:20:25.017482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:20:25.017482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 0 Aug 01 14:20:25.017482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:20:25.017482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:20:25.017482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:20:25.017482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:20:25.017482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-EZ96FtZONeVjGn97GQBV87e0hjxyXGhZMFZML1wFUyCsm1JNsKpPTBiIqLI-kE5icz5dsLBgPFlUy2HP7BpT91GBzqAoEgdTrY3m2WP-KIEPl8yUPbVjJEVaF5phTjWPU-lbDeomQXy-VvfrEU_2PpQ2yT5D3iKbca22i8Cw3syaA Aug 01 14:20:25.017482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:20:25.017482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:20:25.017482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:20:25.017482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:20:25.017482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:20:25.017482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:20:25.017482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: a07d5eb233d349eab325368d9914f3e9 Aug 01 14:20:25.017482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-267598988 Aug 01 14:20:25.017482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:20:25.017482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:20:25.018501 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a07d5eb233d349eab325368d9914f3e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a07d5eb233d349eab325368d9914f3e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a07d5eb233d349eab325368d9914f3e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a07d5eb233d349eab325368d9914f3e9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:20:25.018501 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-VolumesSnapshotsTestJSON-267598988 Aug 01 14:20:25.018501 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: a07d5eb233d349eab325368d9914f3e9 Aug 01 14:20:25.018501 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-267598988 Aug 01 14:20:25.018501 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-VolumesSnapshotsTestJSON-267598988-project Aug 01 14:20:25.018501 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:20:25.018501 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:20:25.018501 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: e47a94fa5e554608aadafdabadd901b9 Aug 01 14:20:25.018501 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-VolumesSnapshotsTestJSON-267598988-project Aug 01 14:20:25.018501 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: Aug 01 14:20:25.018501 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Volume d6ac4ee2-8b80-4d6d-99b9-0023e5012405 could not be found. Aug 01 14:20:25.018501 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'id': 'd6ac4ee2-8b80-4d6d-99b9-0023e5012405'} Aug 01 14:20:25.018501 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:20:25.019092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:25.019092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:20:25.019092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:20:25.019092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:20:25.019092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:20:25.019092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:20:25.019092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:20:25.019092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:20:25.019092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:20:25.019092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:20:25.019092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:20:25.019092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:20:25.019092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:20:25.019092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:20:25.019092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:20:25.019092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d6ac4ee2-8b80-4d6d-99b9-0023e5012405 could not be found. (HTTP 404) (Request-ID: req-05291012-30f2-4bd6-b1e9-085b2aca2f6c) Aug 01 14:20:25.019092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:20:25.019092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:20:25.019092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:20:25.021011 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:25.021011 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 14:20:25.021011 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 14:20:25.021011 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:20:25.021011 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:20:25.021011 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 14:20:25.021011 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 14:20:25.021011 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:20:25.021011 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:20:25.021011 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:20:25.021011 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:20:25.021011 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:20:25.021011 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:20:25.021011 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:20:25.021011 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:20:25.021011 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:20:25.021011 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:20:25.021011 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:20:25.021011 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:20:25.021990 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:20:25.021990 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:20:25.021990 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:20:25.021990 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:20:25.021990 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d6ac4ee2-8b80-4d6d-99b9-0023e5012405 could not be found. Aug 01 14:20:25.021990 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:20:25.021990 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:20:25.021990 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:20:25.021990 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:25.021990 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:20:25.021990 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:20:25.021990 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:20:25.021990 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:20:25.021990 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:20:25.021990 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:20:25.021990 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:20:25.021990 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:20:25.021990 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 14:20:25.021990 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:20:25.022888 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d6ac4ee2-8b80-4d6d-99b9-0023e5012405 could not be found. Aug 01 14:20:25.022888 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:20:25.022888 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:20:25.022888 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:20:25.022888 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:25.022888 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:20:25.022888 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:20:25.022888 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:20:25.022888 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:20:25.022888 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d6ac4ee2-8b80-4d6d-99b9-0023e5012405 could not be found. Aug 01 14:20:25.022888 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:20:25.022888 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-46cfe2e3-25e7-434e-b406-3b1a15ddea27 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] Returning 404 to user: Volume d6ac4ee2-8b80-4d6d-99b9-0023e5012405 could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:20:25.022888 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-46cfe2e3-25e7-434e-b406-3b1a15ddea27 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/d6ac4ee2-8b80-4d6d-99b9-0023e5012405" status: 404 len: 109 microversion: 2.1 time: 0.185015 Aug 01 14:20:25.025346 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 12/24] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Aug 1 14:20:24 2022] GET /compute/v2.1/os-volumes/d6ac4ee2-8b80-4d6d-99b9-0023e5012405 => generated 109 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:20:25.047918 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-2d1254a9-456e-4686-92e1-2cd967c64aec tempest-VolumesTestJSON-1762280700 tempest-VolumesTestJSON-1762280700-project] Calling method '.version_select at 0x7f61871f0820>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:25.089575 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-2a70f069-572e-4fdc-8991-fbf189663e44 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:25.120549 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2a70f069-572e-4fdc-8991-fbf189663e44 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1215 microversion: 2.1 time: 0.315241 Aug 01 14:20:25.129934 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 13/25] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:24 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1215 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:25.149806 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a5b17e97-18ac-4dfb-bf9f-fb419ba41e75 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] Calling method '.version_select at 0x7f61872b1790>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:25.418310 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-2d1254a9-456e-4686-92e1-2cd967c64aec tempest-VolumesTestJSON-1762280700 tempest-VolumesTestJSON-1762280700-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.391767 Aug 01 14:20:25.419366 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 13/26] 10.222.0.17 () {58 vars in 1134 bytes} [Mon Aug 1 14:20:25 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:25.434011 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ca4e6612-efa8-431b-b6bf-2c2d09301fe8 tempest-VolumesTestJSON-1762280700 tempest-VolumesTestJSON-1762280700-project] Calling method '.version_select at 0x7f61869a2040>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:25.644543 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-a5b17e97-18ac-4dfb-bf9f-fb419ba41e75 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] HTTP exception thrown: Volume d6ac4ee2-8b80-4d6d-99b9-0023e5012405 could not be found. Aug 01 14:20:25.649572 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a5b17e97-18ac-4dfb-bf9f-fb419ba41e75 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] Request method failure captured: Aug 01 14:20:25.649572 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: request: DELETE /compute/v2.1/os-volumes/d6ac4ee2-8b80-4d6d-99b9-0023e5012405 HTTP/1.1 Aug 01 14:20:25.649572 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept: application/json Aug 01 14:20:25.649572 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Aug 01 14:20:25.649572 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Connection: close Aug 01 14:20:25.649572 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Length: 0 Aug 01 14:20:25.649572 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Type: application/json Aug 01 14:20:25.649572 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Host: 10.222.0.17 Aug 01 14:20:25.649572 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Aug 01 14:20:25.649572 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.10 Aug 01 14:20:25.649572 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABi5-EZ96FtZONeVjGn97GQBV87e0hjxyXGhZMFZML1wFUyCsm1JNsKpPTBiIqLI-kE5icz5dsLBgPFlUy2HP7BpT91GBzqAoEgdTrY3m2WP-KIEPl8yUPbVjJEVaF5phTjWPU-lbDeomQXy-VvfrEU_2PpQ2yT5D3iKbca22i8Cw3syaA Aug 01 14:20:25.649572 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Aug 01 14:20:25.649572 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Aug 01 14:20:25.649572 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Aug 01 14:20:25.649572 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Aug 01 14:20:25.649572 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Aug 01 14:20:25.649572 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Aug 01 14:20:25.649572 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Id: a07d5eb233d349eab325368d9914f3e9 Aug 01 14:20:25.649572 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-267598988 Aug 01 14:20:25.649572 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Role: reader,member Aug 01 14:20:25.649572 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Roles: reader,member Aug 01 14:20:25.650627 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a07d5eb233d349eab325368d9914f3e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a07d5eb233d349eab325368d9914f3e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a07d5eb233d349eab325368d9914f3e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a07d5eb233d349eab325368d9914f3e9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:20:25.650627 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-VolumesSnapshotsTestJSON-267598988 Aug 01 14:20:25.650627 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Id: a07d5eb233d349eab325368d9914f3e9 Aug 01 14:20:25.650627 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-267598988 Aug 01 14:20:25.650627 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User: tempest-VolumesSnapshotsTestJSON-267598988-project Aug 01 14:20:25.650627 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Aug 01 14:20:25.650627 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Aug 01 14:20:25.650627 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Id: e47a94fa5e554608aadafdabadd901b9 Aug 01 14:20:25.650627 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-VolumesSnapshotsTestJSON-267598988-project Aug 01 14:20:25.650627 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: method: Aug 01 14:20:25.650627 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: exception: Volume d6ac4ee2-8b80-4d6d-99b9-0023e5012405 could not be found. Aug 01 14:20:25.650627 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: action_args: {'id': 'd6ac4ee2-8b80-4d6d-99b9-0023e5012405'} Aug 01 14:20:25.650627 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:20:25.651391 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:25.651391 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:20:25.651391 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:20:25.651391 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 14:20:25.651391 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 14:20:25.651391 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 14:20:25.651391 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 14:20:25.651391 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 14:20:25.651391 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 14:20:25.651391 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 14:20:25.651391 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 14:20:25.651391 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:20:25.651391 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:20:25.651391 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:20:25.651391 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:20:25.651391 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d6ac4ee2-8b80-4d6d-99b9-0023e5012405 could not be found. (HTTP 404) (Request-ID: req-86400471-3a0a-4489-ab83-ef8e235fc489) Aug 01 14:20:25.651391 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:20:25.651391 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:20:25.651391 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:20:25.653134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:25.653134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 14:20:25.653134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 14:20:25.653134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:20:25.653134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:20:25.653134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 14:20:25.653134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 14:20:25.653134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:20:25.653134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:20:25.653134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:20:25.653134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:20:25.653134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 14:20:25.653134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 14:20:25.653134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 14:20:25.653134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 14:20:25.653134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 14:20:25.653134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 14:20:25.653134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 14:20:25.653134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 14:20:25.654281 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:20:25.654281 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:20:25.654281 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:20:25.654281 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:20:25.654281 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d6ac4ee2-8b80-4d6d-99b9-0023e5012405 could not be found. Aug 01 14:20:25.654281 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:20:25.654281 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:20:25.654281 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:20:25.654281 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:25.654281 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:20:25.654281 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:20:25.654281 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:20:25.654281 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:20:25.654281 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:20:25.654281 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:20:25.654281 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:20:25.654281 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:20:25.654281 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 14:20:25.654281 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:20:25.655328 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d6ac4ee2-8b80-4d6d-99b9-0023e5012405 could not be found. Aug 01 14:20:25.655328 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:20:25.655328 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:20:25.655328 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:20:25.655328 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:25.655328 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:20:25.655328 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:20:25.655328 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:20:25.655328 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:20:25.655328 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d6ac4ee2-8b80-4d6d-99b9-0023e5012405 could not be found. Aug 01 14:20:25.655328 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:20:25.655328 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a5b17e97-18ac-4dfb-bf9f-fb419ba41e75 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] Returning 404 to user: Volume d6ac4ee2-8b80-4d6d-99b9-0023e5012405 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:20:25.655328 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a5b17e97-18ac-4dfb-bf9f-fb419ba41e75 tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/d6ac4ee2-8b80-4d6d-99b9-0023e5012405" status: 404 len: 109 microversion: 2.1 time: 0.519812 Aug 01 14:20:25.655328 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 14/27] 10.222.0.17 () {58 vars in 1248 bytes} [Mon Aug 1 14:20:25 2022] DELETE /compute/v2.1/os-volumes/d6ac4ee2-8b80-4d6d-99b9-0023e5012405 => generated 109 bytes in 521 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:20:25.670845 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f132203a-b4ca-495b-80a6-52ed623aa79a tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] Calling method '.version_select at 0x7f61872b1790>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:25.777111 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ca4e6612-efa8-431b-b6bf-2c2d09301fe8 tempest-VolumesTestJSON-1762280700 tempest-VolumesTestJSON-1762280700-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.346544 Aug 01 14:20:25.777248 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 14/28] 10.222.0.17 () {58 vars in 1149 bytes} [Mon Aug 1 14:20:25 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:20:25.793365 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-eb4abea3-a88f-4332-bf52-f3969c12e5fa tempest-VolumesTestJSON-1762280700 tempest-VolumesTestJSON-1762280700-project] Calling method '.version_select at 0x7f61871f0b80>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:25.848718 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-f132203a-b4ca-495b-80a6-52ed623aa79a tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] HTTP exception thrown: Volume d6ac4ee2-8b80-4d6d-99b9-0023e5012405 could not be found. Aug 01 14:20:25.851669 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f132203a-b4ca-495b-80a6-52ed623aa79a tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] Request method failure captured: Aug 01 14:20:25.851669 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/os-volumes/d6ac4ee2-8b80-4d6d-99b9-0023e5012405 HTTP/1.1 Aug 01 14:20:25.851669 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept: application/json Aug 01 14:20:25.851669 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Aug 01 14:20:25.851669 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Connection: close Aug 01 14:20:25.851669 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Length: 0 Aug 01 14:20:25.851669 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Type: application/json Aug 01 14:20:25.851669 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Host: 10.222.0.17 Aug 01 14:20:25.851669 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Aug 01 14:20:25.851669 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.10 Aug 01 14:20:25.851669 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABi5-EZ96FtZONeVjGn97GQBV87e0hjxyXGhZMFZML1wFUyCsm1JNsKpPTBiIqLI-kE5icz5dsLBgPFlUy2HP7BpT91GBzqAoEgdTrY3m2WP-KIEPl8yUPbVjJEVaF5phTjWPU-lbDeomQXy-VvfrEU_2PpQ2yT5D3iKbca22i8Cw3syaA Aug 01 14:20:25.851669 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Aug 01 14:20:25.851669 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Aug 01 14:20:25.851669 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Aug 01 14:20:25.851669 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Aug 01 14:20:25.851669 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Aug 01 14:20:25.851669 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Aug 01 14:20:25.851669 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Id: a07d5eb233d349eab325368d9914f3e9 Aug 01 14:20:25.851669 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-267598988 Aug 01 14:20:25.851669 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Role: reader,member Aug 01 14:20:25.851669 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Roles: reader,member Aug 01 14:20:25.852813 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a07d5eb233d349eab325368d9914f3e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a07d5eb233d349eab325368d9914f3e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a07d5eb233d349eab325368d9914f3e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a07d5eb233d349eab325368d9914f3e9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:20:25.852813 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-VolumesSnapshotsTestJSON-267598988 Aug 01 14:20:25.852813 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Id: a07d5eb233d349eab325368d9914f3e9 Aug 01 14:20:25.852813 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-267598988 Aug 01 14:20:25.852813 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User: tempest-VolumesSnapshotsTestJSON-267598988-project Aug 01 14:20:25.852813 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Aug 01 14:20:25.852813 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Aug 01 14:20:25.852813 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Id: e47a94fa5e554608aadafdabadd901b9 Aug 01 14:20:25.852813 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-VolumesSnapshotsTestJSON-267598988-project Aug 01 14:20:25.852813 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: method: Aug 01 14:20:25.852813 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: exception: Volume d6ac4ee2-8b80-4d6d-99b9-0023e5012405 could not be found. Aug 01 14:20:25.852813 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: action_args: {'id': 'd6ac4ee2-8b80-4d6d-99b9-0023e5012405'} Aug 01 14:20:25.852813 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:20:25.853412 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:25.853412 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:20:25.853412 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:20:25.853412 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:20:25.853412 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:20:25.853412 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:20:25.853412 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:20:25.853412 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:20:25.853412 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:20:25.853412 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:20:25.853412 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:20:25.853412 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:20:25.853412 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:20:25.853412 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:20:25.853412 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:20:25.853412 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d6ac4ee2-8b80-4d6d-99b9-0023e5012405 could not be found. (HTTP 404) (Request-ID: req-c6016c6f-bfb6-4ffc-8b03-24f9ca768f72) Aug 01 14:20:25.853412 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:20:25.853412 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:20:25.853412 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:20:25.854319 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:25.854319 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 14:20:25.854319 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 14:20:25.854319 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:20:25.854319 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:20:25.854319 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 14:20:25.854319 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 14:20:25.854319 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:20:25.854319 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:20:25.854319 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:20:25.854319 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:20:25.854319 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:20:25.854319 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:20:25.854319 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:20:25.854319 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:20:25.854319 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:20:25.854319 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:20:25.854319 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:20:25.854319 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:20:25.855175 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:20:25.855175 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:20:25.855175 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:20:25.855175 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:20:25.855175 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d6ac4ee2-8b80-4d6d-99b9-0023e5012405 could not be found. Aug 01 14:20:25.855175 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:20:25.855175 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:20:25.855175 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:20:25.855175 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:25.855175 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:20:25.855175 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:20:25.855175 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:20:25.855175 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:20:25.855175 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:20:25.855175 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:20:25.855175 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:20:25.855175 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:20:25.855175 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 14:20:25.855175 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:20:25.856075 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d6ac4ee2-8b80-4d6d-99b9-0023e5012405 could not be found. Aug 01 14:20:25.856075 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:20:25.856075 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:20:25.856075 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:20:25.856075 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:25.856075 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:20:25.856075 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:20:25.856075 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:20:25.856075 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:20:25.856075 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d6ac4ee2-8b80-4d6d-99b9-0023e5012405 could not be found. Aug 01 14:20:25.856075 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:20:25.860172 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f132203a-b4ca-495b-80a6-52ed623aa79a tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] Returning 404 to user: Volume d6ac4ee2-8b80-4d6d-99b9-0023e5012405 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:20:25.863386 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f132203a-b4ca-495b-80a6-52ed623aa79a tempest-VolumesSnapshotsTestJSON-267598988 tempest-VolumesSnapshotsTestJSON-267598988-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/d6ac4ee2-8b80-4d6d-99b9-0023e5012405" status: 404 len: 109 microversion: 2.1 time: 0.198754 Aug 01 14:20:25.869177 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 15/29] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Aug 1 14:20:25 2022] GET /compute/v2.1/os-volumes/d6ac4ee2-8b80-4d6d-99b9-0023e5012405 => generated 109 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:20:26.082799 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-eb4abea3-a88f-4332-bf52-f3969c12e5fa tempest-VolumesTestJSON-1762280700 tempest-VolumesTestJSON-1762280700-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.294453 Aug 01 14:20:26.083907 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 15/30] 10.222.0.17 () {58 vars in 1134 bytes} [Mon Aug 1 14:20:25 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:20:26.096559 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-932ba2e3-1f26-494e-bbcc-1322dc2cd3c2 tempest-VolumesTestJSON-1762280700 tempest-VolumesTestJSON-1762280700-project] Calling method '.version_select at 0x7f61869e1310>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:26.151971 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6f689646-2474-4470-a238-c8c9cf2a27e5 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:26.153016 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-6f689646-2474-4470-a238-c8c9cf2a27e5 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:26.360879 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-932ba2e3-1f26-494e-bbcc-1322dc2cd3c2 tempest-VolumesTestJSON-1762280700 tempest-VolumesTestJSON-1762280700-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.268252 Aug 01 14:20:26.371654 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 16/31] 10.222.0.17 () {58 vars in 1167 bytes} [Mon Aug 1 14:20:26 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:26.377051 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8d3e9b56-45dd-4ebd-8fe4-89c14b2a57b8 tempest-VolumesTestJSON-1762280700 tempest-VolumesTestJSON-1762280700-project] Calling method '.version_select at 0x7f61869e1ca0>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:26.673993 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8d3e9b56-45dd-4ebd-8fe4-89c14b2a57b8 tempest-VolumesTestJSON-1762280700 tempest-VolumesTestJSON-1762280700-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.300905 Aug 01 14:20:26.684733 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 17/32] 10.222.0.17 () {58 vars in 1170 bytes} [Mon Aug 1 14:20:26 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:26.690215 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9c59f7df-62a2-4b11-923a-14a1a3796595 tempest-VolumesTestJSON-1762280700 tempest-VolumesTestJSON-1762280700-project] Calling method '.version_select at 0x7f61872b14c0>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:26.903184 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6f689646-2474-4470-a238-c8c9cf2a27e5 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:26.941868 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9c59f7df-62a2-4b11-923a-14a1a3796595 tempest-VolumesTestJSON-1762280700 tempest-VolumesTestJSON-1762280700-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.254921 Aug 01 14:20:26.953915 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 18/33] 10.222.0.17 () {58 vars in 1155 bytes} [Mon Aug 1 14:20:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:26.960115 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c57a627a-11c8-4f9e-b3ed-007c0a776e11 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-842628043", "imageRef": "9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de859ae5-345c-4f53-adf9-d10ff3cac7a2"}], "security_groups": [{"name": "tempest-securitygroup--2118358543"}], "key_name": "tempest-keypair-671634509", "user_data": "}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:20:26.971540 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6f689646-2474-4470-a238-c8c9cf2a27e5 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1215 microversion: 2.1 time: 0.817198 Aug 01 14:20:26.971540 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 16/34] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:26 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1215 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:26.993215 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6881c077-dc5c-4070-9236-2afaa1bce3c2 tempest-VolumesTestJSON-1762280700 tempest-VolumesTestJSON-1762280700-project] Calling method '.version_select at 0x7f61869a2a60>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:27.310089 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6881c077-dc5c-4070-9236-2afaa1bce3c2 tempest-VolumesTestJSON-1762280700 tempest-VolumesTestJSON-1762280700-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.324094 Aug 01 14:20:27.320046 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 17/35] 10.222.0.17 () {58 vars in 1188 bytes} [Mon Aug 1 14:20:26 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:27.325882 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-bded43cf-9f6e-4acd-b2b4-8fad0ed12c5f tempest-VolumesTestJSON-1762280700 tempest-VolumesTestJSON-1762280700-project] Calling method '.version_select at 0x7f61871f09d0>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:27.557045 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.network.neutron [None req-c57a627a-11c8-4f9e-b3ed-007c0a776e11 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] validate_networks() for [('de859ae5-345c-4f53-adf9-d10ff3cac7a2', None, None, None, None, None)] {{(pid=118132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:20:27.584389 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-bded43cf-9f6e-4acd-b2b4-8fad0ed12c5f tempest-VolumesTestJSON-1762280700 tempest-VolumesTestJSON-1762280700-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.262980 Aug 01 14:20:27.585287 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 18/36] 10.222.0.17 () {58 vars in 1155 bytes} [Mon Aug 1 14:20:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:27.998627 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a60f9214-4bbf-4f62-87b7-f1c67be547a4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:27.999257 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a60f9214-4bbf-4f62-87b7-f1c67be547a4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:28.024311 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a60f9214-4bbf-4f62-87b7-f1c67be547a4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:28.034431 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a60f9214-4bbf-4f62-87b7-f1c67be547a4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:28.037174 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a60f9214-4bbf-4f62-87b7-f1c67be547a4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:28.038471 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a60f9214-4bbf-4f62-87b7-f1c67be547a4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:28.681133 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a60f9214-4bbf-4f62-87b7-f1c67be547a4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:28.725751 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a60f9214-4bbf-4f62-87b7-f1c67be547a4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1267 microversion: 2.1 time: 0.731303 Aug 01 14:20:28.743698 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 19/37] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:27 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1267 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:29.760885 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ef9e2fd5-40e4-44c8-978f-d5f639a5811f tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:29.776101 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ef9e2fd5-40e4-44c8-978f-d5f639a5811f tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:29.788877 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ef9e2fd5-40e4-44c8-978f-d5f639a5811f tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:29.790070 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ef9e2fd5-40e4-44c8-978f-d5f639a5811f tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:29.791071 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ef9e2fd5-40e4-44c8-978f-d5f639a5811f tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:29.791730 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ef9e2fd5-40e4-44c8-978f-d5f639a5811f tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:30.079185 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ef9e2fd5-40e4-44c8-978f-d5f639a5811f tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:30.090236 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ef9e2fd5-40e4-44c8-978f-d5f639a5811f tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1273 microversion: 2.1 time: 0.335963 Aug 01 14:20:30.094390 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 20/38] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:29 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1273 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:20:30.358438 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-33ed681c-0bee-4050-94eb-f479ce99ceb8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1713328215", "imageRef": "9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f50c02c-bb30-41aa-99c5-63e2fcd2c717"}], "security_groups": [{"name": "tempest-securitygroup--136943713"}], "key_name": "tempest-keypair-1434419082", "user_data": "}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:20:30.436606 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-c57a627a-11c8-4f9e-b3ed-007c0a776e11 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Flavor limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:20:30.437452 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-c57a627a-11c8-4f9e-b3ed-007c0a776e11 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Image limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:20:30.438212 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-c57a627a-11c8-4f9e-b3ed-007c0a776e11 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Flavor pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:20:30.439236 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-c57a627a-11c8-4f9e-b3ed-007c0a776e11 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Image pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:20:30.440424 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-c57a627a-11c8-4f9e-b3ed-007c0a776e11 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:20:30.468486 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c57a627a-11c8-4f9e-b3ed-007c0a776e11 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:30.469647 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c57a627a-11c8-4f9e-b3ed-007c0a776e11 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:30.475732 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c57a627a-11c8-4f9e-b3ed-007c0a776e11 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:30.476315 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c57a627a-11c8-4f9e-b3ed-007c0a776e11 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:30.591595 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-c57a627a-11c8-4f9e-b3ed-007c0a776e11 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Getting quotas for project 3092982f3c6f4851a5a6e84bf7872d11. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:20:30.609227 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-c57a627a-11c8-4f9e-b3ed-007c0a776e11 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Getting quotas for user 9eda4e19122444cf9cb2b6941adff9d5 and project 3092982f3c6f4851a5a6e84bf7872d11. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:20:30.672833 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c57a627a-11c8-4f9e-b3ed-007c0a776e11 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Going to run 1 instances... {{(pid=118132) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:20:30.682630 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.network.neutron [None req-33ed681c-0bee-4050-94eb-f479ce99ceb8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] validate_networks() for [('6f50c02c-bb30-41aa-99c5-63e2fcd2c717', None, None, None, None, None)] {{(pid=118133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:20:30.684283 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c57a627a-11c8-4f9e-b3ed-007c0a776e11 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:20:30.866835 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c57a627a-11c8-4f9e-b3ed-007c0a776e11 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.911412 Aug 01 14:20:30.873438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 19/39] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Aug 1 14:20:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 3914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:20:31.907605 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ae37529d-b03b-42da-99a9-f87902d69704 tempest-VolumesGetTestJSON-1215305922 tempest-VolumesGetTestJSON-1215305922-project] Action: 'create', calling method: .version_select at 0x7f61869770d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-10962843", "metadata": {"Type": "work"}}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:20:31.997649 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-33ed681c-0bee-4050-94eb-f479ce99ceb8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Flavor limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:20:31.998667 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-33ed681c-0bee-4050-94eb-f479ce99ceb8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Image limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:20:31.999431 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-33ed681c-0bee-4050-94eb-f479ce99ceb8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Flavor pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:20:32.000042 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-33ed681c-0bee-4050-94eb-f479ce99ceb8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Image pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:20:32.000601 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-33ed681c-0bee-4050-94eb-f479ce99ceb8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:20:32.024333 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-33ed681c-0bee-4050-94eb-f479ce99ceb8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:32.026753 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-33ed681c-0bee-4050-94eb-f479ce99ceb8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:32.029186 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-33ed681c-0bee-4050-94eb-f479ce99ceb8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:32.030946 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-33ed681c-0bee-4050-94eb-f479ce99ceb8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:32.098333 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-33ed681c-0bee-4050-94eb-f479ce99ceb8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Getting quotas for project 2fb1590048254549bb480d677892031f. Resources: {'instances', 'cores', 'ram'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:20:32.125098 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-33ed681c-0bee-4050-94eb-f479ce99ceb8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Getting quotas for user fbaa67d901e34419b1616a8457fbd683 and project 2fb1590048254549bb480d677892031f. Resources: {'instances', 'cores', 'ram'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:20:32.195871 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-33ed681c-0bee-4050-94eb-f479ce99ceb8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Going to run 1 instances... {{(pid=118133) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:20:32.200146 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-33ed681c-0bee-4050-94eb-f479ce99ceb8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:20:32.440384 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-33ed681c-0bee-4050-94eb-f479ce99ceb8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.087752 Aug 01 14:20:32.456655 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 21/40] 10.222.0.17 () {62 vars in 1188 bytes} [Mon Aug 1 14:20:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 2103 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 01 14:20:32.491706 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b7273fcd-8119-4319-925c-256beb4dc25b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:32.495147 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b7273fcd-8119-4319-925c-256beb4dc25b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:32.736566 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b7273fcd-8119-4319-925c-256beb4dc25b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:32.747774 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b7273fcd-8119-4319-925c-256beb4dc25b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1240 microversion: 2.1 time: 0.289706 Aug 01 14:20:32.750870 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 22/41] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:32 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1240 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:32.774833 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9f639275-d253-4e02-84ec-cae2feb63f2b tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:32.775749 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9f639275-d253-4e02-84ec-cae2feb63f2b tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:32.812316 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9f639275-d253-4e02-84ec-cae2feb63f2b tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:32.812768 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9f639275-d253-4e02-84ec-cae2feb63f2b tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:32.813536 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9f639275-d253-4e02-84ec-cae2feb63f2b tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:32.813965 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9f639275-d253-4e02-84ec-cae2feb63f2b tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:33.464532 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ae37529d-b03b-42da-99a9-f87902d69704 tempest-VolumesGetTestJSON-1215305922 tempest-VolumesGetTestJSON-1215305922-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 2.592694 Aug 01 14:20:33.475001 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 20/42] 10.222.0.17 () {60 vars in 1156 bytes} [Mon Aug 1 14:20:30 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 2606 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 01 14:20:33.480772 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c4fc7cb3-5d4c-4488-a4d1-4052d5863fa5 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:33.481898 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c4fc7cb3-5d4c-4488-a4d1-4052d5863fa5 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:33.769200 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c4fc7cb3-5d4c-4488-a4d1-4052d5863fa5 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:33.801579 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c4fc7cb3-5d4c-4488-a4d1-4052d5863fa5 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:33.810313 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9f639275-d253-4e02-84ec-cae2feb63f2b tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:33.811638 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c4fc7cb3-5d4c-4488-a4d1-4052d5863fa5 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:33.816387 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c4fc7cb3-5d4c-4488-a4d1-4052d5863fa5 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1282 microversion: 2.20 time: 0.337811 Aug 01 14:20:33.832581 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 21/43] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:33 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1282 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:20:33.835775 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9f639275-d253-4e02-84ec-cae2feb63f2b tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1315 microversion: 2.1 time: 1.067335 Aug 01 14:20:33.836668 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 23/44] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:32 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1315 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:33.849196 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-aad801f9-0e1f-41d3-b59d-18da30987504 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:33.853165 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-aad801f9-0e1f-41d3-b59d-18da30987504 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:33.856670 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ab4cb732-8504-4bed-9a00-30846ac72ad3 tempest-VolumesGetTestJSON-1215305922 tempest-VolumesGetTestJSON-1215305922-project] Calling method '.version_select at 0x7f6186977b80>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:33.886473 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aad801f9-0e1f-41d3-b59d-18da30987504 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:33.890577 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aad801f9-0e1f-41d3-b59d-18da30987504 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:33.897212 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aad801f9-0e1f-41d3-b59d-18da30987504 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:33.902147 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aad801f9-0e1f-41d3-b59d-18da30987504 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:34.059105 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ab4cb732-8504-4bed-9a00-30846ac72ad3 tempest-VolumesGetTestJSON-1215305922 tempest-VolumesGetTestJSON-1215305922-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/47709b5f-188c-4d90-8d0b-72543f770f52" status: 200 len: 351 microversion: 2.1 time: 0.224558 Aug 01 14:20:34.060186 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 22/45] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Aug 1 14:20:33 2022] GET /compute/v2.1/os-volumes/47709b5f-188c-4d90-8d0b-72543f770f52 => generated 351 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:34.797259 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-aad801f9-0e1f-41d3-b59d-18da30987504 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:34.816997 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-aad801f9-0e1f-41d3-b59d-18da30987504 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1244 microversion: 2.1 time: 0.976450 Aug 01 14:20:34.820841 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 24/46] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:33 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1244 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:34.844898 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e71e2bc0-e65a-4e65-b198-1f5f0bab9c1d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:34.846189 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e71e2bc0-e65a-4e65-b198-1f5f0bab9c1d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:34.857379 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-88d75dff-365a-4973-8e03-20f6e4bae5ab tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:34.858367 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-88d75dff-365a-4973-8e03-20f6e4bae5ab tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:34.883204 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e71e2bc0-e65a-4e65-b198-1f5f0bab9c1d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:34.891985 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e71e2bc0-e65a-4e65-b198-1f5f0bab9c1d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:34.892926 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e71e2bc0-e65a-4e65-b198-1f5f0bab9c1d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:34.893365 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e71e2bc0-e65a-4e65-b198-1f5f0bab9c1d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:34.895913 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-88d75dff-365a-4973-8e03-20f6e4bae5ab tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:34.896513 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-88d75dff-365a-4973-8e03-20f6e4bae5ab tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:34.897327 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-88d75dff-365a-4973-8e03-20f6e4bae5ab tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:34.897759 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-88d75dff-365a-4973-8e03-20f6e4bae5ab tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:35.461504 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-88d75dff-365a-4973-8e03-20f6e4bae5ab tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:35.470853 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-88d75dff-365a-4973-8e03-20f6e4bae5ab tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1315 microversion: 2.1 time: 0.617665 Aug 01 14:20:35.476191 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 25/47] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:34 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1315 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:20:35.484120 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e9d6b3e4-5d8b-4a4c-82ca-6af62ef6a49a tempest-VolumesGetTestJSON-1215305922 tempest-VolumesGetTestJSON-1215305922-project] Calling method '.version_select at 0x7f61860e8a60>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:35.692900 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e9d6b3e4-5d8b-4a4c-82ca-6af62ef6a49a tempest-VolumesGetTestJSON-1215305922 tempest-VolumesGetTestJSON-1215305922-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/47709b5f-188c-4d90-8d0b-72543f770f52" status: 200 len: 352 microversion: 2.1 time: 0.215152 Aug 01 14:20:35.694107 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 26/48] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Aug 1 14:20:35 2022] GET /compute/v2.1/os-volumes/47709b5f-188c-4d90-8d0b-72543f770f52 => generated 352 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:35.709374 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-94df1aa8-2e42-4fe4-9ce4-21caf363a114 tempest-VolumesGetTestJSON-1215305922 tempest-VolumesGetTestJSON-1215305922-project] Calling method '.version_select at 0x7f6186082d30>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:35.885705 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-94df1aa8-2e42-4fe4-9ce4-21caf363a114 tempest-VolumesGetTestJSON-1215305922 tempest-VolumesGetTestJSON-1215305922-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/47709b5f-188c-4d90-8d0b-72543f770f52" status: 200 len: 352 microversion: 2.1 time: 0.182477 Aug 01 14:20:35.887149 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 27/49] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Aug 1 14:20:35 2022] GET /compute/v2.1/os-volumes/47709b5f-188c-4d90-8d0b-72543f770f52 => generated 352 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:20:35.892714 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-aa0bdaeb-a8aa-4e4c-86d0-232a610a8b02 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:35.894518 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-aa0bdaeb-a8aa-4e4c-86d0-232a610a8b02 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:35.932663 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e71e2bc0-e65a-4e65-b198-1f5f0bab9c1d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:35.952568 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa0bdaeb-a8aa-4e4c-86d0-232a610a8b02 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:35.953026 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa0bdaeb-a8aa-4e4c-86d0-232a610a8b02 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:35.953801 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa0bdaeb-a8aa-4e4c-86d0-232a610a8b02 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:35.954230 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa0bdaeb-a8aa-4e4c-86d0-232a610a8b02 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:35.977627 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e71e2bc0-e65a-4e65-b198-1f5f0bab9c1d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:35.983984 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e71e2bc0-e65a-4e65-b198-1f5f0bab9c1d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:35.985364 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e71e2bc0-e65a-4e65-b198-1f5f0bab9c1d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1334 microversion: 2.20 time: 1.144593 Aug 01 14:20:36.000491 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 23/50] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:34 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1334 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:20:36.012824 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6e9955ff-8e9f-4621-b808-cb0c868a65c5 tempest-VolumesGetTestJSON-1215305922 tempest-VolumesGetTestJSON-1215305922-project] Calling method '.version_select at 0x7f61858db430>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:36.290784 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-aa0bdaeb-a8aa-4e4c-86d0-232a610a8b02 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:36.306263 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6e9955ff-8e9f-4621-b808-cb0c868a65c5 tempest-VolumesGetTestJSON-1215305922 tempest-VolumesGetTestJSON-1215305922-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/47709b5f-188c-4d90-8d0b-72543f770f52" status: 202 len: 0 microversion: 2.1 time: 0.304142 Aug 01 14:20:36.308474 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 24/51] 10.222.0.17 () {58 vars in 1248 bytes} [Mon Aug 1 14:20:36 2022] DELETE /compute/v2.1/os-volumes/47709b5f-188c-4d90-8d0b-72543f770f52 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:20:36.328189 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-aa0bdaeb-a8aa-4e4c-86d0-232a610a8b02 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1310 microversion: 2.1 time: 0.439572 Aug 01 14:20:36.328861 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-009eaa6c-7163-46f6-bd0c-41a764e3e547 tempest-VolumesGetTestJSON-1215305922 tempest-VolumesGetTestJSON-1215305922-project] Calling method '.version_select at 0x7f61858f3670>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:36.332425 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 28/52] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:35 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1310 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:36.511879 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b9a11cb6-109e-495c-af21-4bc04910f691 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:36.512917 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b9a11cb6-109e-495c-af21-4bc04910f691 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:36.538755 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b9a11cb6-109e-495c-af21-4bc04910f691 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:36.539297 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b9a11cb6-109e-495c-af21-4bc04910f691 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:36.548371 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b9a11cb6-109e-495c-af21-4bc04910f691 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:36.553509 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b9a11cb6-109e-495c-af21-4bc04910f691 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:36.823241 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-009eaa6c-7163-46f6-bd0c-41a764e3e547 tempest-VolumesGetTestJSON-1215305922 tempest-VolumesGetTestJSON-1215305922-project] HTTP exception thrown: Volume 47709b5f-188c-4d90-8d0b-72543f770f52 could not be found. Aug 01 14:20:36.825993 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-009eaa6c-7163-46f6-bd0c-41a764e3e547 tempest-VolumesGetTestJSON-1215305922 tempest-VolumesGetTestJSON-1215305922-project] Request method failure captured: Aug 01 14:20:36.825993 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/os-volumes/47709b5f-188c-4d90-8d0b-72543f770f52 HTTP/1.1 Aug 01 14:20:36.825993 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept: application/json Aug 01 14:20:36.825993 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Aug 01 14:20:36.825993 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Connection: close Aug 01 14:20:36.825993 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Length: 0 Aug 01 14:20:36.825993 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Type: application/json Aug 01 14:20:36.825993 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Host: 10.222.0.17 Aug 01 14:20:36.825993 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Aug 01 14:20:36.825993 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.10 Aug 01 14:20:36.825993 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABi5-EukafN5sXFeyUaSsnOFaS1DiyaTOeYtGbcSBUj9AQDcjbG-l-4yUMKIhE_U2FJvKPRgBqGD4rRhZSLksQRSaxvymnA1VRqYggBkQR5Zsn7P4gmewZ6TLUviVLzfMfU-hcKSssYfWavoyztGDrkUBH7w5OkKxh2xDZ1AnDu2JgvlVk Aug 01 14:20:36.825993 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Aug 01 14:20:36.825993 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Aug 01 14:20:36.825993 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Aug 01 14:20:36.825993 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Aug 01 14:20:36.825993 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Aug 01 14:20:36.825993 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Aug 01 14:20:36.825993 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Id: ee3d21cda75742ef9ee0aceb194da05e Aug 01 14:20:36.825993 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-VolumesGetTestJSON-1215305922 Aug 01 14:20:36.825993 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Role: reader,member Aug 01 14:20:36.825993 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Roles: reader,member Aug 01 14:20:36.829173 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ee3d21cda75742ef9ee0aceb194da05e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ee3d21cda75742ef9ee0aceb194da05e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ee3d21cda75742ef9ee0aceb194da05e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ee3d21cda75742ef9ee0aceb194da05e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:20:36.829173 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-VolumesGetTestJSON-1215305922 Aug 01 14:20:36.829173 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Id: ee3d21cda75742ef9ee0aceb194da05e Aug 01 14:20:36.829173 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-VolumesGetTestJSON-1215305922 Aug 01 14:20:36.829173 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User: tempest-VolumesGetTestJSON-1215305922-project Aug 01 14:20:36.829173 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Aug 01 14:20:36.829173 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Aug 01 14:20:36.829173 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Id: d14d32969d0d45f59a9f5f2b8c367e13 Aug 01 14:20:36.829173 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-VolumesGetTestJSON-1215305922-project Aug 01 14:20:36.829173 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: method: Aug 01 14:20:36.829173 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: exception: Volume 47709b5f-188c-4d90-8d0b-72543f770f52 could not be found. Aug 01 14:20:36.829173 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: action_args: {'id': '47709b5f-188c-4d90-8d0b-72543f770f52'} Aug 01 14:20:36.829173 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:20:36.829915 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:36.829915 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:20:36.829915 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:20:36.829915 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:20:36.829915 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:20:36.829915 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:20:36.829915 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:20:36.829915 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:20:36.829915 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:20:36.829915 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:20:36.829915 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:20:36.829915 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:20:36.829915 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:20:36.829915 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:20:36.829915 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:20:36.829915 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 47709b5f-188c-4d90-8d0b-72543f770f52 could not be found. (HTTP 404) (Request-ID: req-328e426e-d60a-4108-aee4-48ffae858cf5) Aug 01 14:20:36.829915 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:20:36.829915 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:20:36.829915 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:20:36.831026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:36.831026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 14:20:36.831026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 14:20:36.831026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:20:36.831026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:20:36.831026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 14:20:36.831026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 14:20:36.831026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:20:36.831026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:20:36.831026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:20:36.831026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:20:36.831026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:20:36.831026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:20:36.831026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:20:36.831026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:20:36.831026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:20:36.831026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:20:36.831026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:20:36.831026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:20:36.833867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:20:36.833867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:20:36.833867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:20:36.833867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:20:36.833867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 47709b5f-188c-4d90-8d0b-72543f770f52 could not be found. Aug 01 14:20:36.833867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:20:36.833867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:20:36.833867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:20:36.833867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:36.833867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:20:36.833867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:20:36.833867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:20:36.833867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:20:36.833867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:20:36.833867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:20:36.833867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:20:36.833867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:20:36.833867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 14:20:36.833867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:20:36.835330 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 47709b5f-188c-4d90-8d0b-72543f770f52 could not be found. Aug 01 14:20:36.835330 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:20:36.835330 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:20:36.835330 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:20:36.835330 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:36.835330 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:20:36.835330 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:20:36.835330 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:20:36.835330 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:20:36.835330 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 47709b5f-188c-4d90-8d0b-72543f770f52 could not be found. Aug 01 14:20:36.835330 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:20:36.835330 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-009eaa6c-7163-46f6-bd0c-41a764e3e547 tempest-VolumesGetTestJSON-1215305922 tempest-VolumesGetTestJSON-1215305922-project] Returning 404 to user: Volume 47709b5f-188c-4d90-8d0b-72543f770f52 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:20:36.835330 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-009eaa6c-7163-46f6-bd0c-41a764e3e547 tempest-VolumesGetTestJSON-1215305922 tempest-VolumesGetTestJSON-1215305922-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/47709b5f-188c-4d90-8d0b-72543f770f52" status: 404 len: 109 microversion: 2.1 time: 0.514605 Aug 01 14:20:36.840936 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 25/53] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Aug 1 14:20:36 2022] GET /compute/v2.1/os-volumes/47709b5f-188c-4d90-8d0b-72543f770f52 => generated 109 bytes in 528 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:20:37.017509 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-49e1f0c8-8756-4bbb-81d6-f4f5f4336102 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:37.018923 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-49e1f0c8-8756-4bbb-81d6-f4f5f4336102 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:37.049021 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-49e1f0c8-8756-4bbb-81d6-f4f5f4336102 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:37.050762 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-49e1f0c8-8756-4bbb-81d6-f4f5f4336102 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:37.053503 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-49e1f0c8-8756-4bbb-81d6-f4f5f4336102 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:37.059521 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-49e1f0c8-8756-4bbb-81d6-f4f5f4336102 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:37.390856 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-49e1f0c8-8756-4bbb-81d6-f4f5f4336102 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:37.405419 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-49e1f0c8-8756-4bbb-81d6-f4f5f4336102 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:37.415030 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-49e1f0c8-8756-4bbb-81d6-f4f5f4336102 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:37.417433 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-49e1f0c8-8756-4bbb-81d6-f4f5f4336102 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1340 microversion: 2.20 time: 0.406958 Aug 01 14:20:37.425761 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 26/54] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:37 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1340 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:20:37.441618 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-119941c6-e9d5-4051-a61a-b1ea664c55df tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:37.445169 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-119941c6-e9d5-4051-a61a-b1ea664c55df tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:37.471667 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-119941c6-e9d5-4051-a61a-b1ea664c55df tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:37.485403 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-119941c6-e9d5-4051-a61a-b1ea664c55df tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:37.487795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-119941c6-e9d5-4051-a61a-b1ea664c55df tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:37.490335 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-119941c6-e9d5-4051-a61a-b1ea664c55df tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:37.757127 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-119941c6-e9d5-4051-a61a-b1ea664c55df tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:37.769894 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-119941c6-e9d5-4051-a61a-b1ea664c55df tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1298 microversion: 2.1 time: 0.341619 Aug 01 14:20:37.776720 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 27/55] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:37 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1298 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:37.816546 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b9a11cb6-109e-495c-af21-4bc04910f691 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:37.833922 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b9a11cb6-109e-495c-af21-4bc04910f691 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1315 microversion: 2.1 time: 1.335405 Aug 01 14:20:37.850110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 29/56] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:36 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1315 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:20:38.152471 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-14b1545e-bbf6-4177-834c-86ce65dda2b4 req-3a5cfc62-6c9d-4c1b-a654-cf154a3b009a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6574d506-2cc2-4d16-87d3-eefee1edb1e8", "tag": "b4ee4c3d-69b1-4db4-b0f0-968da4c540a8"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:20:38.172235 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-14b1545e-bbf6-4177-834c-86ce65dda2b4 req-3a5cfc62-6c9d-4c1b-a654-cf154a3b009a service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:38.173104 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-14b1545e-bbf6-4177-834c-86ce65dda2b4 req-3a5cfc62-6c9d-4c1b-a654-cf154a3b009a service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:38.202878 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-14b1545e-bbf6-4177-834c-86ce65dda2b4 req-3a5cfc62-6c9d-4c1b-a654-cf154a3b009a service nova] Creating event network-changed:b4ee4c3d-69b1-4db4-b0f0-968da4c540a8 for instance 6574d506-2cc2-4d16-87d3-eefee1edb1e8 on hv-cinder-84599 Aug 01 14:20:38.203989 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-14b1545e-bbf6-4177-834c-86ce65dda2b4 req-3a5cfc62-6c9d-4c1b-a654-cf154a3b009a service nova] Acquired lock "compute-rpcapi-router" {{(pid=118132) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 01 14:20:38.206039 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2231c4ce-5708-47a4-a0f8-049d87732942 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:38.207112 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2231c4ce-5708-47a4-a0f8-049d87732942 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:38.210880 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2231c4ce-5708-47a4-a0f8-049d87732942 None None] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:38.211814 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2231c4ce-5708-47a4-a0f8-049d87732942 None None] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:38.224052 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.compute.rpcapi [None req-2231c4ce-5708-47a4-a0f8-049d87732942 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 01 14:20:38.226133 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2231c4ce-5708-47a4-a0f8-049d87732942 None None] Releasing lock "compute-rpcapi-router" {{(pid=118132) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 01 14:20:38.261256 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2231c4ce-5708-47a4-a0f8-049d87732942 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.468909 Aug 01 14:20:38.262123 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 28/57] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:38.453658 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3e4931e2-1265-401b-8b61-f6b9a1ff3d23 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:38.454852 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3e4931e2-1265-401b-8b61-f6b9a1ff3d23 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:38.483268 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e4931e2-1265-401b-8b61-f6b9a1ff3d23 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:38.484182 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e4931e2-1265-401b-8b61-f6b9a1ff3d23 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:38.485570 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e4931e2-1265-401b-8b61-f6b9a1ff3d23 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:38.486438 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e4931e2-1265-401b-8b61-f6b9a1ff3d23 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:38.809892 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-05aa97a8-26b9-4b66-a408-34b4db5f6260 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:38.811160 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-05aa97a8-26b9-4b66-a408-34b4db5f6260 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:38.813575 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3e4931e2-1265-401b-8b61-f6b9a1ff3d23 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:38.828903 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3e4931e2-1265-401b-8b61-f6b9a1ff3d23 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:38.838870 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3e4931e2-1265-401b-8b61-f6b9a1ff3d23 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:38.845822 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3e4931e2-1265-401b-8b61-f6b9a1ff3d23 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1340 microversion: 2.20 time: 0.400020 Aug 01 14:20:38.849464 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05aa97a8-26b9-4b66-a408-34b4db5f6260 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:38.849667 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 30/58] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:38 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1340 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:20:38.850945 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05aa97a8-26b9-4b66-a408-34b4db5f6260 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:38.854079 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05aa97a8-26b9-4b66-a408-34b4db5f6260 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:38.855003 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05aa97a8-26b9-4b66-a408-34b4db5f6260 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:38.860043 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-52db6634-500c-47a4-b13a-ce7cb792d4e3 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:38.868173 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-52db6634-500c-47a4-b13a-ce7cb792d4e3 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:38.885333 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-52db6634-500c-47a4-b13a-ce7cb792d4e3 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:38.895147 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-52db6634-500c-47a4-b13a-ce7cb792d4e3 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:38.896624 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-52db6634-500c-47a4-b13a-ce7cb792d4e3 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:38.897072 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-52db6634-500c-47a4-b13a-ce7cb792d4e3 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:39.300418 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-05aa97a8-26b9-4b66-a408-34b4db5f6260 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:39.309722 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-05aa97a8-26b9-4b66-a408-34b4db5f6260 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1298 microversion: 2.1 time: 0.512887 Aug 01 14:20:39.331858 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 29/59] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:38 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1298 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:39.696445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-52db6634-500c-47a4-b13a-ce7cb792d4e3 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:39.723719 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-52db6634-500c-47a4-b13a-ce7cb792d4e3 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1315 microversion: 2.1 time: 0.862818 Aug 01 14:20:39.740495 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 31/60] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:38 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1315 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:39.886266 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-65409d5f-eec9-41bc-864b-b5517dc5a6dd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:39.886974 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-65409d5f-eec9-41bc-864b-b5517dc5a6dd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:39.899708 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-65409d5f-eec9-41bc-864b-b5517dc5a6dd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:39.902500 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-65409d5f-eec9-41bc-864b-b5517dc5a6dd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:39.903428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-65409d5f-eec9-41bc-864b-b5517dc5a6dd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:39.907324 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-65409d5f-eec9-41bc-864b-b5517dc5a6dd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:40.343917 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c4bf6ea2-0802-4974-9a75-44b609f2d552 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:40.345254 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c4bf6ea2-0802-4974-9a75-44b609f2d552 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:40.393089 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c4bf6ea2-0802-4974-9a75-44b609f2d552 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:40.400214 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c4bf6ea2-0802-4974-9a75-44b609f2d552 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:40.402942 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c4bf6ea2-0802-4974-9a75-44b609f2d552 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:40.408207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c4bf6ea2-0802-4974-9a75-44b609f2d552 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:40.577528 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-65409d5f-eec9-41bc-864b-b5517dc5a6dd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:40.616769 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-65409d5f-eec9-41bc-864b-b5517dc5a6dd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:40.628480 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-65409d5f-eec9-41bc-864b-b5517dc5a6dd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:40.636658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-65409d5f-eec9-41bc-864b-b5517dc5a6dd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1407 microversion: 2.20 time: 0.747890 Aug 01 14:20:40.679959 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 30/61] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:39 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1407 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:20:40.774110 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-873595a0-2e30-4e6c-97f2-5318cde6ccd7 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:40.775307 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-873595a0-2e30-4e6c-97f2-5318cde6ccd7 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:40.794129 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-873595a0-2e30-4e6c-97f2-5318cde6ccd7 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:40.796232 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-873595a0-2e30-4e6c-97f2-5318cde6ccd7 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:40.797335 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-873595a0-2e30-4e6c-97f2-5318cde6ccd7 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:40.800134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-873595a0-2e30-4e6c-97f2-5318cde6ccd7 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:42.070995 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=4 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:42.208684 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c4bf6ea2-0802-4974-9a75-44b609f2d552 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:42.240188 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c4bf6ea2-0802-4974-9a75-44b609f2d552 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1366 microversion: 2.1 time: 1.894505 Aug 01 14:20:42.245352 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 32/62] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:40 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1366 bytes in 1909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:42.270742 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a4ab050a-6a51-46cb-a1c3-9cfa8d2c50d0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:42.289936 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a4ab050a-6a51-46cb-a1c3-9cfa8d2c50d0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:42.330255 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a4ab050a-6a51-46cb-a1c3-9cfa8d2c50d0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:42.337291 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a4ab050a-6a51-46cb-a1c3-9cfa8d2c50d0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:42.339981 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a4ab050a-6a51-46cb-a1c3-9cfa8d2c50d0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:42.341246 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a4ab050a-6a51-46cb-a1c3-9cfa8d2c50d0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:42.585213 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-873595a0-2e30-4e6c-97f2-5318cde6ccd7 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:42.596283 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-873595a0-2e30-4e6c-97f2-5318cde6ccd7 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1315 microversion: 2.1 time: 1.827330 Aug 01 14:20:42.597606 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 31/63] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:40 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1315 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:42.608083 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-46f4cf81-aad7-4a28-8c70-9488316d72c1 req-e1043e62-b630-4070-932f-7e609a6636a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76deb7da-88aa-4c26-b55d-fd6432d1e680", "tag": "e905a309-fe29-4762-880d-f6eb375da04f"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:20:42.654631 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-46f4cf81-aad7-4a28-8c70-9488316d72c1 req-e1043e62-b630-4070-932f-7e609a6636a8 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:42.669771 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-46f4cf81-aad7-4a28-8c70-9488316d72c1 req-e1043e62-b630-4070-932f-7e609a6636a8 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:42.718162 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-46f4cf81-aad7-4a28-8c70-9488316d72c1 req-e1043e62-b630-4070-932f-7e609a6636a8 service nova] Creating event network-changed:e905a309-fe29-4762-880d-f6eb375da04f for instance 76deb7da-88aa-4c26-b55d-fd6432d1e680 on hv-cinder-84599 Aug 01 14:20:42.740485 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-46f4cf81-aad7-4a28-8c70-9488316d72c1 req-e1043e62-b630-4070-932f-7e609a6636a8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133350 Aug 01 14:20:42.743533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 32/64] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:42.748102 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=16 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:43.269448 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-15b8f58c-c189-4435-bc04-3d8be2009700 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:43.270750 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-15b8f58c-c189-4435-bc04-3d8be2009700 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:43.290941 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-15b8f58c-c189-4435-bc04-3d8be2009700 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:43.291593 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-15b8f58c-c189-4435-bc04-3d8be2009700 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:43.292449 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-15b8f58c-c189-4435-bc04-3d8be2009700 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:43.292902 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-15b8f58c-c189-4435-bc04-3d8be2009700 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:43.504665 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a4ab050a-6a51-46cb-a1c3-9cfa8d2c50d0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:43.516169 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a4ab050a-6a51-46cb-a1c3-9cfa8d2c50d0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:43.528502 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a4ab050a-6a51-46cb-a1c3-9cfa8d2c50d0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:43.530054 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a4ab050a-6a51-46cb-a1c3-9cfa8d2c50d0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1407 microversion: 2.20 time: 1.273539 Aug 01 14:20:43.531809 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 33/65] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:42 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1407 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:20:43.633941 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ca80adc5-a5cd-45a7-b1c2-e0e3b82022ba tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:43.634938 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ca80adc5-a5cd-45a7-b1c2-e0e3b82022ba tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:43.638035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=6 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:43.651297 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ca80adc5-a5cd-45a7-b1c2-e0e3b82022ba tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:43.656493 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ca80adc5-a5cd-45a7-b1c2-e0e3b82022ba tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:43.657634 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ca80adc5-a5cd-45a7-b1c2-e0e3b82022ba tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:43.658476 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ca80adc5-a5cd-45a7-b1c2-e0e3b82022ba tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:43.775428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=18 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:44.201861 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ca80adc5-a5cd-45a7-b1c2-e0e3b82022ba tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:44.213561 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ca80adc5-a5cd-45a7-b1c2-e0e3b82022ba tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1315 microversion: 2.1 time: 0.584279 Aug 01 14:20:44.217427 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 34/66] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:43 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1315 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:20:44.343832 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-15b8f58c-c189-4435-bc04-3d8be2009700 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:44.358132 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-15b8f58c-c189-4435-bc04-3d8be2009700 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1366 microversion: 2.1 time: 1.093043 Aug 01 14:20:44.358749 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 33/67] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:43 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1366 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:20:44.556829 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-09f23bee-7ab1-4e4b-888c-3ab513506e89 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:44.557567 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-09f23bee-7ab1-4e4b-888c-3ab513506e89 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:44.572238 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-09f23bee-7ab1-4e4b-888c-3ab513506e89 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:44.572707 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-09f23bee-7ab1-4e4b-888c-3ab513506e89 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:44.639517 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-09f23bee-7ab1-4e4b-888c-3ab513506e89 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:44.639517 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-09f23bee-7ab1-4e4b-888c-3ab513506e89 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.061s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:45.241716 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-68c3d01e-1fae-47e5-9a02-c242e0010b49 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:45.242335 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-68c3d01e-1fae-47e5-9a02-c242e0010b49 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:45.257378 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-68c3d01e-1fae-47e5-9a02-c242e0010b49 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:45.262529 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-68c3d01e-1fae-47e5-9a02-c242e0010b49 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:45.266298 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-68c3d01e-1fae-47e5-9a02-c242e0010b49 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:45.267203 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-68c3d01e-1fae-47e5-9a02-c242e0010b49 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:45.797232 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-09f23bee-7ab1-4e4b-888c-3ab513506e89 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:45.812097 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-09f23bee-7ab1-4e4b-888c-3ab513506e89 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:45.818134 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-09f23bee-7ab1-4e4b-888c-3ab513506e89 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:45.819529 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-09f23bee-7ab1-4e4b-888c-3ab513506e89 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1407 microversion: 2.20 time: 1.267873 Aug 01 14:20:45.823927 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 35/68] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:44 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1407 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:20:45.840597 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d979119e-15c3-478c-a9e0-c5fb107485ed tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:45.841577 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d979119e-15c3-478c-a9e0-c5fb107485ed tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:45.860483 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d979119e-15c3-478c-a9e0-c5fb107485ed tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:45.867263 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d979119e-15c3-478c-a9e0-c5fb107485ed tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:45.870790 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d979119e-15c3-478c-a9e0-c5fb107485ed tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:45.880170 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d979119e-15c3-478c-a9e0-c5fb107485ed tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:45.908546 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-68c3d01e-1fae-47e5-9a02-c242e0010b49 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:45.930553 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-68c3d01e-1fae-47e5-9a02-c242e0010b49 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1315 microversion: 2.1 time: 0.693100 Aug 01 14:20:45.944097 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 34/69] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:45 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1315 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:46.220825 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d979119e-15c3-478c-a9e0-c5fb107485ed tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:46.233247 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d979119e-15c3-478c-a9e0-c5fb107485ed tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1366 microversion: 2.1 time: 0.407901 Aug 01 14:20:46.233837 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 36/70] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:45 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1366 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:46.721627 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-697a7d80-28a8-41cf-bcc7-c6ca9112f724 req-924ea00c-4fbe-4f06-b26a-6b8009bdc1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdb50660-a83d-4b80-9be9-f1c264f3d711", "tag": "549718cd-576c-4fb6-9df8-7e4cef065b1b"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:20:46.744655 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-697a7d80-28a8-41cf-bcc7-c6ca9112f724 req-924ea00c-4fbe-4f06-b26a-6b8009bdc1f5 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:46.747276 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-697a7d80-28a8-41cf-bcc7-c6ca9112f724 req-924ea00c-4fbe-4f06-b26a-6b8009bdc1f5 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:46.773433 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-697a7d80-28a8-41cf-bcc7-c6ca9112f724 req-924ea00c-4fbe-4f06-b26a-6b8009bdc1f5 service nova] Creating event network-changed:549718cd-576c-4fb6-9df8-7e4cef065b1b for instance fdb50660-a83d-4b80-9be9-f1c264f3d711 on hv-cinder-84599 Aug 01 14:20:46.784637 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-697a7d80-28a8-41cf-bcc7-c6ca9112f724 req-924ea00c-4fbe-4f06-b26a-6b8009bdc1f5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.778325 Aug 01 14:20:46.790068 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 35/71] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:20:46.851642 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-06a7ed25-ba1e-4822-bb13-63d02dc42dc2 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:46.853145 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-06a7ed25-ba1e-4822-bb13-63d02dc42dc2 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:46.863060 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-06a7ed25-ba1e-4822-bb13-63d02dc42dc2 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:46.864720 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-06a7ed25-ba1e-4822-bb13-63d02dc42dc2 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:46.865930 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-06a7ed25-ba1e-4822-bb13-63d02dc42dc2 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:46.866597 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-06a7ed25-ba1e-4822-bb13-63d02dc42dc2 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:46.977684 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-41522031-5ba5-4fc7-a566-9f7dd30e464d tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:46.978435 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-41522031-5ba5-4fc7-a566-9f7dd30e464d tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:46.994475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-41522031-5ba5-4fc7-a566-9f7dd30e464d tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:46.994934 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-41522031-5ba5-4fc7-a566-9f7dd30e464d tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:46.995738 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-41522031-5ba5-4fc7-a566-9f7dd30e464d tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:46.996183 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-41522031-5ba5-4fc7-a566-9f7dd30e464d tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:47.061591 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-06a7ed25-ba1e-4822-bb13-63d02dc42dc2 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:47.070885 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-06a7ed25-ba1e-4822-bb13-63d02dc42dc2 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:47.072452 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-06a7ed25-ba1e-4822-bb13-63d02dc42dc2 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:47.074452 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-06a7ed25-ba1e-4822-bb13-63d02dc42dc2 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1407 microversion: 2.20 time: 0.229175 Aug 01 14:20:47.075066 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 37/72] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:46 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:20:47.198436 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-41522031-5ba5-4fc7-a566-9f7dd30e464d tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:47.206142 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-41522031-5ba5-4fc7-a566-9f7dd30e464d tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1315 microversion: 2.1 time: 0.236290 Aug 01 14:20:47.207025 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 36/73] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:46 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:20:47.276471 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8120f247-ab8f-4361-8b7a-ebc015d2ea39 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:47.277875 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8120f247-ab8f-4361-8b7a-ebc015d2ea39 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:47.290154 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8120f247-ab8f-4361-8b7a-ebc015d2ea39 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:47.290603 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8120f247-ab8f-4361-8b7a-ebc015d2ea39 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:47.291583 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8120f247-ab8f-4361-8b7a-ebc015d2ea39 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:47.292021 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8120f247-ab8f-4361-8b7a-ebc015d2ea39 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:47.459275 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8120f247-ab8f-4361-8b7a-ebc015d2ea39 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:47.463800 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=100 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:47.468916 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8120f247-ab8f-4361-8b7a-ebc015d2ea39 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1366 microversion: 2.1 time: 0.201668 Aug 01 14:20:47.469938 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 38/74] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:47 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:48.100893 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-fede39ad-ecea-417f-9a9c-7590434c2e31 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:48.102515 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-fede39ad-ecea-417f-9a9c-7590434c2e31 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:48.120652 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fede39ad-ecea-417f-9a9c-7590434c2e31 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:48.121109 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fede39ad-ecea-417f-9a9c-7590434c2e31 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:48.121893 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fede39ad-ecea-417f-9a9c-7590434c2e31 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:48.122334 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fede39ad-ecea-417f-9a9c-7590434c2e31 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:48.222277 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=4 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:48.239621 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5369ada8-edca-4668-82ca-888ef7146ef8 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:48.240960 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5369ada8-edca-4668-82ca-888ef7146ef8 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:48.248602 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5369ada8-edca-4668-82ca-888ef7146ef8 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:48.249196 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5369ada8-edca-4668-82ca-888ef7146ef8 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:48.250106 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5369ada8-edca-4668-82ca-888ef7146ef8 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:48.250642 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5369ada8-edca-4668-82ca-888ef7146ef8 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:48.287321 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-fede39ad-ecea-417f-9a9c-7590434c2e31 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:48.296277 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-fede39ad-ecea-417f-9a9c-7590434c2e31 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:48.298888 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-fede39ad-ecea-417f-9a9c-7590434c2e31 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:48.300168 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-fede39ad-ecea-417f-9a9c-7590434c2e31 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1407 microversion: 2.20 time: 0.207551 Aug 01 14:20:48.308225 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 37/75] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:48 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:20:48.422588 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5369ada8-edca-4668-82ca-888ef7146ef8 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:48.433335 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5369ada8-edca-4668-82ca-888ef7146ef8 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1315 microversion: 2.1 time: 0.198510 Aug 01 14:20:48.435506 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 39/76] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:48 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:48.491940 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-14392410-2ebd-4992-9e06-fa3e7edf4f04 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:48.492442 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-14392410-2ebd-4992-9e06-fa3e7edf4f04 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:48.499510 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-14392410-2ebd-4992-9e06-fa3e7edf4f04 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:48.500186 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-14392410-2ebd-4992-9e06-fa3e7edf4f04 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:48.501224 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-14392410-2ebd-4992-9e06-fa3e7edf4f04 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:48.501719 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-14392410-2ebd-4992-9e06-fa3e7edf4f04 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:48.684202 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-14392410-2ebd-4992-9e06-fa3e7edf4f04 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:48.693604 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-14392410-2ebd-4992-9e06-fa3e7edf4f04 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1366 microversion: 2.1 time: 0.205787 Aug 01 14:20:48.694578 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 38/77] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:48 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:49.328241 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-741aa798-548e-45c5-abbd-9afce705a1c8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:49.330262 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-741aa798-548e-45c5-abbd-9afce705a1c8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:49.341101 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-741aa798-548e-45c5-abbd-9afce705a1c8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:49.341866 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-741aa798-548e-45c5-abbd-9afce705a1c8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:49.343238 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-741aa798-548e-45c5-abbd-9afce705a1c8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:49.344753 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-741aa798-548e-45c5-abbd-9afce705a1c8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:49.460529 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c6479e64-1828-4058-93ef-04fc1e482641 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:49.461588 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c6479e64-1828-4058-93ef-04fc1e482641 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:49.471132 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=5 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:49.473977 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c6479e64-1828-4058-93ef-04fc1e482641 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:49.474806 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c6479e64-1828-4058-93ef-04fc1e482641 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:49.476206 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c6479e64-1828-4058-93ef-04fc1e482641 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:49.477360 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c6479e64-1828-4058-93ef-04fc1e482641 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:49.558300 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-741aa798-548e-45c5-abbd-9afce705a1c8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:49.569857 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-741aa798-548e-45c5-abbd-9afce705a1c8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:49.571858 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-741aa798-548e-45c5-abbd-9afce705a1c8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:49.575372 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-741aa798-548e-45c5-abbd-9afce705a1c8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1407 microversion: 2.20 time: 0.253408 Aug 01 14:20:49.577135 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 40/78] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:49 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:20:49.716109 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b4019771-bc96-4d84-bd58-dc4a5d36c3db tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:49.716995 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b4019771-bc96-4d84-bd58-dc4a5d36c3db tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:49.727165 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b4019771-bc96-4d84-bd58-dc4a5d36c3db tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:49.727945 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b4019771-bc96-4d84-bd58-dc4a5d36c3db tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:49.729459 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b4019771-bc96-4d84-bd58-dc4a5d36c3db tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:49.730746 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b4019771-bc96-4d84-bd58-dc4a5d36c3db tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:49.744664 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c6479e64-1828-4058-93ef-04fc1e482641 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:49.783812 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c6479e64-1828-4058-93ef-04fc1e482641 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1315 microversion: 2.1 time: 0.326820 Aug 01 14:20:49.784508 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 39/79] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:49 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:49.941465 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b4019771-bc96-4d84-bd58-dc4a5d36c3db tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:49.954535 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b4019771-bc96-4d84-bd58-dc4a5d36c3db tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1366 microversion: 2.1 time: 0.238110 Aug 01 14:20:49.962594 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 41/80] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:49 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:20:50.626276 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c1bcac0a-e728-4f0f-ad9a-f81fdfba6e5f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:50.630145 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c1bcac0a-e728-4f0f-ad9a-f81fdfba6e5f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:50.647332 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c1bcac0a-e728-4f0f-ad9a-f81fdfba6e5f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:50.648898 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c1bcac0a-e728-4f0f-ad9a-f81fdfba6e5f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:50.653547 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c1bcac0a-e728-4f0f-ad9a-f81fdfba6e5f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:50.654764 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c1bcac0a-e728-4f0f-ad9a-f81fdfba6e5f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:50.815951 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b402bee2-e11f-4fce-bbf7-bc14300b6009 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:50.817435 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b402bee2-e11f-4fce-bbf7-bc14300b6009 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:50.838468 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b402bee2-e11f-4fce-bbf7-bc14300b6009 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:50.852506 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b402bee2-e11f-4fce-bbf7-bc14300b6009 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:50.853564 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b402bee2-e11f-4fce-bbf7-bc14300b6009 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:50.854009 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b402bee2-e11f-4fce-bbf7-bc14300b6009 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:50.931636 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c1bcac0a-e728-4f0f-ad9a-f81fdfba6e5f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:50.945178 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c1bcac0a-e728-4f0f-ad9a-f81fdfba6e5f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:50.946971 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c1bcac0a-e728-4f0f-ad9a-f81fdfba6e5f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:50.948750 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c1bcac0a-e728-4f0f-ad9a-f81fdfba6e5f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1407 microversion: 2.20 time: 0.335346 Aug 01 14:20:50.964123 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 40/81] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:50 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1407 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:20:50.980741 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-41edf2ce-e3f0-4fce-8211-e2190d6fc53a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:50.981630 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-41edf2ce-e3f0-4fce-8211-e2190d6fc53a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:50.991269 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-41edf2ce-e3f0-4fce-8211-e2190d6fc53a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:50.991747 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-41edf2ce-e3f0-4fce-8211-e2190d6fc53a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:50.992589 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-41edf2ce-e3f0-4fce-8211-e2190d6fc53a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:50.993054 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-41edf2ce-e3f0-4fce-8211-e2190d6fc53a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:51.037680 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b402bee2-e11f-4fce-bbf7-bc14300b6009 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:51.049044 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b402bee2-e11f-4fce-bbf7-bc14300b6009 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1315 microversion: 2.1 time: 0.241340 Aug 01 14:20:51.059772 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 42/82] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:50 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:51.156158 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-41edf2ce-e3f0-4fce-8211-e2190d6fc53a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:51.168489 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-41edf2ce-e3f0-4fce-8211-e2190d6fc53a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1366 microversion: 2.1 time: 0.194207 Aug 01 14:20:51.169394 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 41/83] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:50 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:51.981479 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6e809545-06fe-4fc5-88dd-dd20b8ad3253 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:51.983286 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-6e809545-06fe-4fc5-88dd-dd20b8ad3253 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:51.997723 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6e809545-06fe-4fc5-88dd-dd20b8ad3253 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:51.999124 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6e809545-06fe-4fc5-88dd-dd20b8ad3253 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:52.001995 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6e809545-06fe-4fc5-88dd-dd20b8ad3253 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:52.003116 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6e809545-06fe-4fc5-88dd-dd20b8ad3253 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:52.072152 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-19692088-3417-447d-8d47-3514c550415a tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:52.074420 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-19692088-3417-447d-8d47-3514c550415a tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:52.083568 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-19692088-3417-447d-8d47-3514c550415a tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:52.085384 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-19692088-3417-447d-8d47-3514c550415a tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:52.086995 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-19692088-3417-447d-8d47-3514c550415a tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:52.087862 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-19692088-3417-447d-8d47-3514c550415a tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:52.261882 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6e809545-06fe-4fc5-88dd-dd20b8ad3253 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:52.274945 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6e809545-06fe-4fc5-88dd-dd20b8ad3253 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:52.277801 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6e809545-06fe-4fc5-88dd-dd20b8ad3253 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:52.279669 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6e809545-06fe-4fc5-88dd-dd20b8ad3253 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1407 microversion: 2.20 time: 0.308787 Aug 01 14:20:52.281032 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 43/84] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:51 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1407 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:20:52.287706 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8d28553a-1202-4c98-8e37-45fa30fb2f32 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:52.288571 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8d28553a-1202-4c98-8e37-45fa30fb2f32 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:52.295658 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8d28553a-1202-4c98-8e37-45fa30fb2f32 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:52.296458 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8d28553a-1202-4c98-8e37-45fa30fb2f32 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:52.297606 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8d28553a-1202-4c98-8e37-45fa30fb2f32 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:52.298362 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8d28553a-1202-4c98-8e37-45fa30fb2f32 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:52.317872 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-19692088-3417-447d-8d47-3514c550415a tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:52.321278 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=100 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:52.330441 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-19692088-3417-447d-8d47-3514c550415a tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1315 microversion: 2.1 time: 0.262563 Aug 01 14:20:52.331221 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 42/85] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:52 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:20:52.508885 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8d28553a-1202-4c98-8e37-45fa30fb2f32 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:52.526946 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8d28553a-1202-4c98-8e37-45fa30fb2f32 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1366 microversion: 2.1 time: 0.244169 Aug 01 14:20:52.536129 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 44/86] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:52 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:53.325495 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8e9e2f32-dd9d-4023-a414-b4383c0e4cc4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:53.326802 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-8e9e2f32-dd9d-4023-a414-b4383c0e4cc4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:53.338037 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8e9e2f32-dd9d-4023-a414-b4383c0e4cc4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:53.338489 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8e9e2f32-dd9d-4023-a414-b4383c0e4cc4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:53.339354 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8e9e2f32-dd9d-4023-a414-b4383c0e4cc4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:53.339950 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8e9e2f32-dd9d-4023-a414-b4383c0e4cc4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:53.361933 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a00bcdf1-ac58-4ab8-9eb5-351a4bc262f4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:53.365854 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a00bcdf1-ac58-4ab8-9eb5-351a4bc262f4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:53.387723 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a00bcdf1-ac58-4ab8-9eb5-351a4bc262f4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:53.390208 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a00bcdf1-ac58-4ab8-9eb5-351a4bc262f4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:53.396039 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a00bcdf1-ac58-4ab8-9eb5-351a4bc262f4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:53.397490 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a00bcdf1-ac58-4ab8-9eb5-351a4bc262f4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:53.651959 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-8e9e2f32-dd9d-4023-a414-b4383c0e4cc4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:53.677860 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-8e9e2f32-dd9d-4023-a414-b4383c0e4cc4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:53.684469 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-8e9e2f32-dd9d-4023-a414-b4383c0e4cc4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:53.689939 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8e9e2f32-dd9d-4023-a414-b4383c0e4cc4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1407 microversion: 2.20 time: 0.367529 Aug 01 14:20:53.693948 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 43/87] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:53 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1407 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:20:53.709763 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ead05ea9-6a7a-4b7a-82d1-b3dfc43697dc tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:53.711414 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ead05ea9-6a7a-4b7a-82d1-b3dfc43697dc tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:53.738139 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ead05ea9-6a7a-4b7a-82d1-b3dfc43697dc tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:53.739284 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ead05ea9-6a7a-4b7a-82d1-b3dfc43697dc tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:53.744165 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ead05ea9-6a7a-4b7a-82d1-b3dfc43697dc tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:53.744472 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ead05ea9-6a7a-4b7a-82d1-b3dfc43697dc tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:53.825917 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a00bcdf1-ac58-4ab8-9eb5-351a4bc262f4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:53.834869 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a00bcdf1-ac58-4ab8-9eb5-351a4bc262f4 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1315 microversion: 2.1 time: 0.480624 Aug 01 14:20:53.841031 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 45/88] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:53 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:54.118343 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ead05ea9-6a7a-4b7a-82d1-b3dfc43697dc tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:54.128469 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ead05ea9-6a7a-4b7a-82d1-b3dfc43697dc tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1366 microversion: 2.1 time: 0.432935 Aug 01 14:20:54.129274 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 44/89] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:53 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1366 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:54.740992 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5e74f5e7-5c42-45ee-88cf-445099f95475 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:54.741606 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5e74f5e7-5c42-45ee-88cf-445099f95475 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:54.749372 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5e74f5e7-5c42-45ee-88cf-445099f95475 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:54.750032 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5e74f5e7-5c42-45ee-88cf-445099f95475 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:54.752002 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5e74f5e7-5c42-45ee-88cf-445099f95475 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:54.752002 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5e74f5e7-5c42-45ee-88cf-445099f95475 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:54.880432 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7e7913f4-ac81-4527-a265-94d60277c923 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:54.881044 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7e7913f4-ac81-4527-a265-94d60277c923 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:54.896127 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7e7913f4-ac81-4527-a265-94d60277c923 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:54.897201 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7e7913f4-ac81-4527-a265-94d60277c923 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:54.898262 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7e7913f4-ac81-4527-a265-94d60277c923 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:54.901714 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7e7913f4-ac81-4527-a265-94d60277c923 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:55.033906 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5e74f5e7-5c42-45ee-88cf-445099f95475 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:55.046303 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5e74f5e7-5c42-45ee-88cf-445099f95475 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:55.048323 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5e74f5e7-5c42-45ee-88cf-445099f95475 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:55.050704 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5e74f5e7-5c42-45ee-88cf-445099f95475 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1407 microversion: 2.20 time: 0.313120 Aug 01 14:20:55.052120 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 46/90] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:54 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1407 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:20:55.151980 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0fc31ebe-4bd4-4468-9f39-e7104df9adaa tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:55.152585 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0fc31ebe-4bd4-4468-9f39-e7104df9adaa tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:55.171944 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0fc31ebe-4bd4-4468-9f39-e7104df9adaa tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:55.171944 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0fc31ebe-4bd4-4468-9f39-e7104df9adaa tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:55.171944 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0fc31ebe-4bd4-4468-9f39-e7104df9adaa tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:55.171944 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0fc31ebe-4bd4-4468-9f39-e7104df9adaa tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:55.172849 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7e7913f4-ac81-4527-a265-94d60277c923 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:55.178536 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7e7913f4-ac81-4527-a265-94d60277c923 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1315 microversion: 2.1 time: 0.303838 Aug 01 14:20:55.179659 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 45/91] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:54 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:55.421958 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0fc31ebe-4bd4-4468-9f39-e7104df9adaa tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:55.438004 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0fc31ebe-4bd4-4468-9f39-e7104df9adaa tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1366 microversion: 2.1 time: 0.289600 Aug 01 14:20:55.439728 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 47/92] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:55 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:20:56.086507 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-25125b03-1356-4314-9a08-f2d47505e2ef tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:56.089829 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-25125b03-1356-4314-9a08-f2d47505e2ef tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:56.106342 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-25125b03-1356-4314-9a08-f2d47505e2ef tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:56.107981 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-25125b03-1356-4314-9a08-f2d47505e2ef tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:56.110205 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-25125b03-1356-4314-9a08-f2d47505e2ef tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:56.110493 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-25125b03-1356-4314-9a08-f2d47505e2ef tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:56.207587 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-55019926-149c-437f-b907-341bea22a905 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:56.208213 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-55019926-149c-437f-b907-341bea22a905 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:56.217376 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-55019926-149c-437f-b907-341bea22a905 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:56.218024 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-55019926-149c-437f-b907-341bea22a905 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:56.218811 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-55019926-149c-437f-b907-341bea22a905 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:56.220400 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-55019926-149c-437f-b907-341bea22a905 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:56.339627 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-25125b03-1356-4314-9a08-f2d47505e2ef tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:56.352105 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-25125b03-1356-4314-9a08-f2d47505e2ef tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:56.363684 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-25125b03-1356-4314-9a08-f2d47505e2ef tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:56.363684 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-25125b03-1356-4314-9a08-f2d47505e2ef tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1407 microversion: 2.20 time: 0.280367 Aug 01 14:20:56.363684 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 46/93] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:56 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:20:56.462089 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-12f79091-f3d0-4fff-966d-bd35890cd525 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:56.462942 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-12f79091-f3d0-4fff-966d-bd35890cd525 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:56.470679 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-12f79091-f3d0-4fff-966d-bd35890cd525 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:56.471336 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-55019926-149c-437f-b907-341bea22a905 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:56.473504 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-12f79091-f3d0-4fff-966d-bd35890cd525 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:56.475766 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-12f79091-f3d0-4fff-966d-bd35890cd525 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:56.477558 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-12f79091-f3d0-4fff-966d-bd35890cd525 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:56.482247 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-55019926-149c-437f-b907-341bea22a905 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1315 microversion: 2.1 time: 0.278981 Aug 01 14:20:56.483104 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 48/94] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:56 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:20:56.694168 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-12f79091-f3d0-4fff-966d-bd35890cd525 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:56.704027 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-12f79091-f3d0-4fff-966d-bd35890cd525 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1366 microversion: 2.1 time: 0.246721 Aug 01 14:20:56.704801 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 47/95] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:56 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:57.383887 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-cd7fae7e-1d72-4686-a436-895add8fe96c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:57.387375 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-cd7fae7e-1d72-4686-a436-895add8fe96c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:57.402005 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cd7fae7e-1d72-4686-a436-895add8fe96c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:57.403210 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cd7fae7e-1d72-4686-a436-895add8fe96c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:57.404887 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cd7fae7e-1d72-4686-a436-895add8fe96c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:57.406480 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cd7fae7e-1d72-4686-a436-895add8fe96c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:57.510474 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-673fe13f-02be-498a-8d47-c6c6eddafeb8 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:57.512364 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-673fe13f-02be-498a-8d47-c6c6eddafeb8 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:57.521661 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-673fe13f-02be-498a-8d47-c6c6eddafeb8 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:57.522747 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-673fe13f-02be-498a-8d47-c6c6eddafeb8 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:57.523982 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-673fe13f-02be-498a-8d47-c6c6eddafeb8 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:57.524444 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-673fe13f-02be-498a-8d47-c6c6eddafeb8 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:57.845640 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-cd7fae7e-1d72-4686-a436-895add8fe96c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:57.856762 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-cd7fae7e-1d72-4686-a436-895add8fe96c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:57.867895 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-cd7fae7e-1d72-4686-a436-895add8fe96c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:57.872674 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-cd7fae7e-1d72-4686-a436-895add8fe96c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1407 microversion: 2.20 time: 0.494911 Aug 01 14:20:57.876569 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 49/96] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:57 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1407 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:20:57.898166 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e155c092-2634-4908-8a96-1c8af921d8be tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:57.898775 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e155c092-2634-4908-8a96-1c8af921d8be tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:57.917982 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e155c092-2634-4908-8a96-1c8af921d8be tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:57.919567 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e155c092-2634-4908-8a96-1c8af921d8be tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:57.921414 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e155c092-2634-4908-8a96-1c8af921d8be tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:57.922468 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e155c092-2634-4908-8a96-1c8af921d8be tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:58.086917 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-673fe13f-02be-498a-8d47-c6c6eddafeb8 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:58.122394 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-673fe13f-02be-498a-8d47-c6c6eddafeb8 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1315 microversion: 2.1 time: 0.620356 Aug 01 14:20:58.123012 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 48/97] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:57 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1315 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:20:58.307264 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e155c092-2634-4908-8a96-1c8af921d8be tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:58.317553 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e155c092-2634-4908-8a96-1c8af921d8be tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1366 microversion: 2.1 time: 0.438546 Aug 01 14:20:58.318480 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 50/98] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:57 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1366 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:58.902372 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-aa658b12-43ed-45b2-995a-6363169b2b1d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:58.903319 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-aa658b12-43ed-45b2-995a-6363169b2b1d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:58.911516 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aa658b12-43ed-45b2-995a-6363169b2b1d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:58.912025 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aa658b12-43ed-45b2-995a-6363169b2b1d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:58.912997 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aa658b12-43ed-45b2-995a-6363169b2b1d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:58.913495 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aa658b12-43ed-45b2-995a-6363169b2b1d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:59.152547 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-aa658b12-43ed-45b2-995a-6363169b2b1d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:59.158660 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-fafdd3cb-ce46-4fa9-9819-f2dfe38327f9 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:59.159772 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-fafdd3cb-ce46-4fa9-9819-f2dfe38327f9 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:59.173415 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-aa658b12-43ed-45b2-995a-6363169b2b1d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:59.175589 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fafdd3cb-ce46-4fa9-9819-f2dfe38327f9 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:59.176068 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fafdd3cb-ce46-4fa9-9819-f2dfe38327f9 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:59.176865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fafdd3cb-ce46-4fa9-9819-f2dfe38327f9 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:59.177298 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fafdd3cb-ce46-4fa9-9819-f2dfe38327f9 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:59.180237 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-aa658b12-43ed-45b2-995a-6363169b2b1d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:59.181415 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-aa658b12-43ed-45b2-995a-6363169b2b1d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1407 microversion: 2.20 time: 0.284431 Aug 01 14:20:59.182053 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 49/99] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:58 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1407 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:20:59.360315 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-add382b4-aa85-45d6-81c4-3fdfdddc0117 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:59.361105 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-add382b4-aa85-45d6-81c4-3fdfdddc0117 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:59.384042 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-add382b4-aa85-45d6-81c4-3fdfdddc0117 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:59.384495 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-add382b4-aa85-45d6-81c4-3fdfdddc0117 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:59.387721 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-add382b4-aa85-45d6-81c4-3fdfdddc0117 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:59.388172 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-add382b4-aa85-45d6-81c4-3fdfdddc0117 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:59.463078 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-fafdd3cb-ce46-4fa9-9819-f2dfe38327f9 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:59.475073 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-fafdd3cb-ce46-4fa9-9819-f2dfe38327f9 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1315 microversion: 2.1 time: 0.325606 Aug 01 14:20:59.475746 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 51/100] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:59 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:59.689152 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-add382b4-aa85-45d6-81c4-3fdfdddc0117 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:59.707870 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-add382b4-aa85-45d6-81c4-3fdfdddc0117 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1366 microversion: 2.1 time: 0.357275 Aug 01 14:20:59.708827 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 50/101] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:59 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1366 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:00.219630 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-48f312da-b240-46ef-813d-174f24f356d8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:00.220325 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-48f312da-b240-46ef-813d-174f24f356d8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:00.231703 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-48f312da-b240-46ef-813d-174f24f356d8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:00.232167 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-48f312da-b240-46ef-813d-174f24f356d8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:00.232951 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-48f312da-b240-46ef-813d-174f24f356d8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:00.241260 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-48f312da-b240-46ef-813d-174f24f356d8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:00.485919 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-48f312da-b240-46ef-813d-174f24f356d8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:00.499174 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-48f312da-b240-46ef-813d-174f24f356d8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:00.508665 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-48f312da-b240-46ef-813d-174f24f356d8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:00.513546 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-48f312da-b240-46ef-813d-174f24f356d8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1407 microversion: 2.20 time: 0.297648 Aug 01 14:21:00.518830 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-89be43bd-639c-4032-a528-e8dce63e9d6e tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:00.523912 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-89be43bd-639c-4032-a528-e8dce63e9d6e tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:00.546066 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-89be43bd-639c-4032-a528-e8dce63e9d6e tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:00.548298 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 52/102] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:00 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1407 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:21:00.551221 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-89be43bd-639c-4032-a528-e8dce63e9d6e tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:00.552668 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-89be43bd-639c-4032-a528-e8dce63e9d6e tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:00.554634 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-89be43bd-639c-4032-a528-e8dce63e9d6e tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:00.742146 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f9de0775-d083-4c68-89d0-d06cb462c582 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:00.744635 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f9de0775-d083-4c68-89d0-d06cb462c582 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:00.772208 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f9de0775-d083-4c68-89d0-d06cb462c582 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:00.772637 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f9de0775-d083-4c68-89d0-d06cb462c582 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:00.776520 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f9de0775-d083-4c68-89d0-d06cb462c582 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:00.776971 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f9de0775-d083-4c68-89d0-d06cb462c582 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:00.901907 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-89be43bd-639c-4032-a528-e8dce63e9d6e tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:00.918073 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-89be43bd-639c-4032-a528-e8dce63e9d6e tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1315 microversion: 2.1 time: 0.410286 Aug 01 14:21:00.918709 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 51/103] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:00 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:01.247845 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-7c67a568-33a8-4fb2-b6cd-70343c75d89d req-3a6d9aab-305a-4322-9631-5c7cd625eefc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6574d506-2cc2-4d16-87d3-eefee1edb1e8", "name": "network-vif-plugged", "status": "completed", "tag": "b4ee4c3d-69b1-4db4-b0f0-968da4c540a8"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:01.270890 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-7c67a568-33a8-4fb2-b6cd-70343c75d89d req-3a6d9aab-305a-4322-9631-5c7cd625eefc service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:01.271342 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-7c67a568-33a8-4fb2-b6cd-70343c75d89d req-3a6d9aab-305a-4322-9631-5c7cd625eefc service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:01.312551 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-7c67a568-33a8-4fb2-b6cd-70343c75d89d req-3a6d9aab-305a-4322-9631-5c7cd625eefc service nova] Creating event network-vif-plugged:b4ee4c3d-69b1-4db4-b0f0-968da4c540a8 for instance 6574d506-2cc2-4d16-87d3-eefee1edb1e8 on hv-cinder-84599 Aug 01 14:21:01.318850 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-7c67a568-33a8-4fb2-b6cd-70343c75d89d req-3a6d9aab-305a-4322-9631-5c7cd625eefc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.393750 Aug 01 14:21:01.319520 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 52/104] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:21:01.479663 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f9de0775-d083-4c68-89d0-d06cb462c582 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:01.493271 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f9de0775-d083-4c68-89d0-d06cb462c582 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1366 microversion: 2.1 time: 0.758334 Aug 01 14:21:01.520091 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 53/105] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:00 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1366 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:01.552712 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7c2808b3-ca05-48c5-a3e0-dfc2757605d8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:01.554342 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7c2808b3-ca05-48c5-a3e0-dfc2757605d8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:01.573949 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7c2808b3-ca05-48c5-a3e0-dfc2757605d8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:01.574405 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7c2808b3-ca05-48c5-a3e0-dfc2757605d8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:01.575189 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7c2808b3-ca05-48c5-a3e0-dfc2757605d8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:01.575723 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7c2808b3-ca05-48c5-a3e0-dfc2757605d8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:01.846101 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7c2808b3-ca05-48c5-a3e0-dfc2757605d8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:01.862385 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7c2808b3-ca05-48c5-a3e0-dfc2757605d8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:01.864942 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7c2808b3-ca05-48c5-a3e0-dfc2757605d8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:01.868657 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7c2808b3-ca05-48c5-a3e0-dfc2757605d8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1407 microversion: 2.20 time: 0.322246 Aug 01 14:21:01.884497 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 53/106] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:01 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1407 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:21:01.961003 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a8c87eda-d6d0-4829-97d0-995f414efb00 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:01.961629 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a8c87eda-d6d0-4829-97d0-995f414efb00 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:01.983093 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a8c87eda-d6d0-4829-97d0-995f414efb00 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:01.983583 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a8c87eda-d6d0-4829-97d0-995f414efb00 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:01.986697 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a8c87eda-d6d0-4829-97d0-995f414efb00 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:01.989157 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a8c87eda-d6d0-4829-97d0-995f414efb00 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:02.526699 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a8c87eda-d6d0-4829-97d0-995f414efb00 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:02.530894 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1828f107-76ef-4c5d-8f97-bf1c0d62f6d6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:02.531856 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-1828f107-76ef-4c5d-8f97-bf1c0d62f6d6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:02.567549 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a8c87eda-d6d0-4829-97d0-995f414efb00 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1315 microversion: 2.1 time: 0.609846 Aug 01 14:21:02.573629 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 54/107] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:01 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1315 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:02.574945 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1828f107-76ef-4c5d-8f97-bf1c0d62f6d6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:02.576129 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1828f107-76ef-4c5d-8f97-bf1c0d62f6d6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:02.578232 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1828f107-76ef-4c5d-8f97-bf1c0d62f6d6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:02.583617 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1828f107-76ef-4c5d-8f97-bf1c0d62f6d6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:02.895931 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-17955225-8809-4cc4-9cc7-f3b38d9132ef tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:02.896725 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-17955225-8809-4cc4-9cc7-f3b38d9132ef tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:02.913854 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-17955225-8809-4cc4-9cc7-f3b38d9132ef tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:02.914851 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-17955225-8809-4cc4-9cc7-f3b38d9132ef tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:02.919602 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-17955225-8809-4cc4-9cc7-f3b38d9132ef tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:02.920982 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-17955225-8809-4cc4-9cc7-f3b38d9132ef tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:02.999619 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1828f107-76ef-4c5d-8f97-bf1c0d62f6d6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:03.007818 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=100 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:03.029999 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-1828f107-76ef-4c5d-8f97-bf1c0d62f6d6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1366 microversion: 2.1 time: 0.502384 Aug 01 14:21:03.032328 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 54/108] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:02 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1366 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:03.164413 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-17955225-8809-4cc4-9cc7-f3b38d9132ef tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:03.174252 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-17955225-8809-4cc4-9cc7-f3b38d9132ef tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:03.177458 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-17955225-8809-4cc4-9cc7-f3b38d9132ef tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:03.179111 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-17955225-8809-4cc4-9cc7-f3b38d9132ef tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1407 microversion: 2.20 time: 0.288860 Aug 01 14:21:03.180267 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 55/109] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:02 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1407 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:21:03.346566 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-95229642-f92b-457a-a895-b59b05996a76 req-b71ebf21-d7d5-40c0-b3ba-4197b4e4b1e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76deb7da-88aa-4c26-b55d-fd6432d1e680", "name": "network-vif-plugged", "status": "completed", "tag": "e905a309-fe29-4762-880d-f6eb375da04f"}, {"server_uuid": "fdb50660-a83d-4b80-9be9-f1c264f3d711", "name": "network-vif-plugged", "status": "completed", "tag": "549718cd-576c-4fb6-9df8-7e4cef065b1b"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:03.369213 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-95229642-f92b-457a-a895-b59b05996a76 req-b71ebf21-d7d5-40c0-b3ba-4197b4e4b1e2 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:03.370044 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-95229642-f92b-457a-a895-b59b05996a76 req-b71ebf21-d7d5-40c0-b3ba-4197b4e4b1e2 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:03.397836 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-95229642-f92b-457a-a895-b59b05996a76 req-b71ebf21-d7d5-40c0-b3ba-4197b4e4b1e2 service nova] Creating event network-vif-plugged:e905a309-fe29-4762-880d-f6eb375da04f for instance 76deb7da-88aa-4c26-b55d-fd6432d1e680 on hv-cinder-84599 Aug 01 14:21:03.398655 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-95229642-f92b-457a-a895-b59b05996a76 req-b71ebf21-d7d5-40c0-b3ba-4197b4e4b1e2 service nova] Creating event network-vif-plugged:549718cd-576c-4fb6-9df8-7e4cef065b1b for instance fdb50660-a83d-4b80-9be9-f1c264f3d711 on hv-cinder-84599 Aug 01 14:21:03.413600 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-95229642-f92b-457a-a895-b59b05996a76 req-b71ebf21-d7d5-40c0-b3ba-4197b4e4b1e2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.074497 Aug 01 14:21:03.414929 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 55/110] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:21:03.611689 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-4e999c93-81d3-463f-b32c-1f019e9c3d1d tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:03.613650 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-4e999c93-81d3-463f-b32c-1f019e9c3d1d tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:03.651783 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4e999c93-81d3-463f-b32c-1f019e9c3d1d tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:03.655140 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4e999c93-81d3-463f-b32c-1f019e9c3d1d tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:03.658662 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4e999c93-81d3-463f-b32c-1f019e9c3d1d tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:03.659190 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4e999c93-81d3-463f-b32c-1f019e9c3d1d tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:03.887471 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4e999c93-81d3-463f-b32c-1f019e9c3d1d tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:03.897062 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-4e999c93-81d3-463f-b32c-1f019e9c3d1d tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1315 microversion: 2.1 time: 0.299381 Aug 01 14:21:03.897994 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 56/111] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:03 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:04.069848 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-cf74b913-208a-4561-925a-8b4f38ccf728 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:04.072006 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-cf74b913-208a-4561-925a-8b4f38ccf728 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:04.083796 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cf74b913-208a-4561-925a-8b4f38ccf728 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:04.084762 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cf74b913-208a-4561-925a-8b4f38ccf728 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:04.086438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cf74b913-208a-4561-925a-8b4f38ccf728 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:04.087361 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cf74b913-208a-4561-925a-8b4f38ccf728 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:04.214391 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-bb20d03b-64f7-4f4e-8496-d8336baead5c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:04.216024 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-bb20d03b-64f7-4f4e-8496-d8336baead5c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:04.235749 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bb20d03b-64f7-4f4e-8496-d8336baead5c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:04.235749 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bb20d03b-64f7-4f4e-8496-d8336baead5c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:04.235749 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bb20d03b-64f7-4f4e-8496-d8336baead5c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:04.235749 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bb20d03b-64f7-4f4e-8496-d8336baead5c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:04.288706 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-cf74b913-208a-4561-925a-8b4f38ccf728 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:04.299890 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-cf74b913-208a-4561-925a-8b4f38ccf728 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1366 microversion: 2.1 time: 0.238095 Aug 01 14:21:04.303206 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 56/112] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:04 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:04.389230 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-bb20d03b-64f7-4f4e-8496-d8336baead5c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:04.397696 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-bb20d03b-64f7-4f4e-8496-d8336baead5c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:04.399196 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-bb20d03b-64f7-4f4e-8496-d8336baead5c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:04.403670 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-bb20d03b-64f7-4f4e-8496-d8336baead5c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1407 microversion: 2.20 time: 0.198463 Aug 01 14:21:04.403670 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 57/113] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:04 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:21:04.920133 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d7d9f893-6497-447a-ad28-50ab170c097f tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:04.921153 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d7d9f893-6497-447a-ad28-50ab170c097f tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:04.928980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d7d9f893-6497-447a-ad28-50ab170c097f tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:04.929577 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d7d9f893-6497-447a-ad28-50ab170c097f tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:04.930795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d7d9f893-6497-447a-ad28-50ab170c097f tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:04.931510 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d7d9f893-6497-447a-ad28-50ab170c097f tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:05.129805 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d7d9f893-6497-447a-ad28-50ab170c097f tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:05.142224 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d7d9f893-6497-447a-ad28-50ab170c097f tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1315 microversion: 2.1 time: 0.226934 Aug 01 14:21:05.142843 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 57/114] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:04 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:05.324433 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-76cc59e2-0050-4eb2-8c86-bd5b8966622d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:05.325355 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-76cc59e2-0050-4eb2-8c86-bd5b8966622d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:05.331805 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-76cc59e2-0050-4eb2-8c86-bd5b8966622d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:05.332337 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-76cc59e2-0050-4eb2-8c86-bd5b8966622d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:05.333013 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-76cc59e2-0050-4eb2-8c86-bd5b8966622d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:05.333449 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-76cc59e2-0050-4eb2-8c86-bd5b8966622d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:05.429534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c4c8e1c6-5f36-40ff-aa1d-59ed217602a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:05.430387 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c4c8e1c6-5f36-40ff-aa1d-59ed217602a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:05.437369 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c4c8e1c6-5f36-40ff-aa1d-59ed217602a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:05.438048 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c4c8e1c6-5f36-40ff-aa1d-59ed217602a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:05.439014 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c4c8e1c6-5f36-40ff-aa1d-59ed217602a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:05.439773 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c4c8e1c6-5f36-40ff-aa1d-59ed217602a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:05.487253 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-76cc59e2-0050-4eb2-8c86-bd5b8966622d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:05.502213 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-76cc59e2-0050-4eb2-8c86-bd5b8966622d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1366 microversion: 2.1 time: 0.182029 Aug 01 14:21:05.502978 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 58/115] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:05 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:05.603013 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c4c8e1c6-5f36-40ff-aa1d-59ed217602a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:05.612375 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c4c8e1c6-5f36-40ff-aa1d-59ed217602a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:05.614467 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c4c8e1c6-5f36-40ff-aa1d-59ed217602a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:05.615619 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c4c8e1c6-5f36-40ff-aa1d-59ed217602a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1407 microversion: 2.20 time: 0.193467 Aug 01 14:21:05.616365 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 58/116] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:05 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:21:06.162259 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0f94c722-71cd-4ff5-ac36-5dfe540dcd01 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:06.162864 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0f94c722-71cd-4ff5-ac36-5dfe540dcd01 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:06.169017 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0f94c722-71cd-4ff5-ac36-5dfe540dcd01 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:06.169467 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0f94c722-71cd-4ff5-ac36-5dfe540dcd01 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:06.170240 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0f94c722-71cd-4ff5-ac36-5dfe540dcd01 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:06.170656 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0f94c722-71cd-4ff5-ac36-5dfe540dcd01 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:06.353713 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0f94c722-71cd-4ff5-ac36-5dfe540dcd01 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:06.362413 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0f94c722-71cd-4ff5-ac36-5dfe540dcd01 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1315 microversion: 2.1 time: 0.203975 Aug 01 14:21:06.363446 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 59/117] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:06 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:06.523846 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-158a458d-e08a-44b5-82f4-672c0f083649 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:06.524523 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-158a458d-e08a-44b5-82f4-672c0f083649 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:06.530970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-158a458d-e08a-44b5-82f4-672c0f083649 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:06.531427 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-158a458d-e08a-44b5-82f4-672c0f083649 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:06.532402 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-158a458d-e08a-44b5-82f4-672c0f083649 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:06.533014 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-158a458d-e08a-44b5-82f4-672c0f083649 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:06.640508 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-39794080-a0be-4aa5-a142-7495e4bc94b7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:06.641652 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-39794080-a0be-4aa5-a142-7495e4bc94b7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:06.651308 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-39794080-a0be-4aa5-a142-7495e4bc94b7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:06.652351 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-39794080-a0be-4aa5-a142-7495e4bc94b7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:06.653162 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-39794080-a0be-4aa5-a142-7495e4bc94b7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:06.654338 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-39794080-a0be-4aa5-a142-7495e4bc94b7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:06.701444 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-158a458d-e08a-44b5-82f4-672c0f083649 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:06.710988 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-158a458d-e08a-44b5-82f4-672c0f083649 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1366 microversion: 2.1 time: 0.190880 Aug 01 14:21:06.712003 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 59/118] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:06 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:06.831781 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-39794080-a0be-4aa5-a142-7495e4bc94b7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:06.844056 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-39794080-a0be-4aa5-a142-7495e4bc94b7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:06.845805 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-39794080-a0be-4aa5-a142-7495e4bc94b7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:06.848456 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-39794080-a0be-4aa5-a142-7495e4bc94b7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1407 microversion: 2.20 time: 0.212525 Aug 01 14:21:06.850293 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 60/119] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:06 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:21:07.376878 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-24c43ce2-0a40-440b-852f-3fe8fff0e56a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-846645876", "imageRef": "9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1", "flavorRef": "452", "networks": [{"uuid": "1b803e73-7491-4f9c-b808-c7c452f92be3"}]}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:07.387041 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-578b9ab0-ff12-446b-bb0d-6b1fb8b1ecd9 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:07.388229 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-578b9ab0-ff12-446b-bb0d-6b1fb8b1ecd9 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:07.401303 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-578b9ab0-ff12-446b-bb0d-6b1fb8b1ecd9 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:07.402432 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-578b9ab0-ff12-446b-bb0d-6b1fb8b1ecd9 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:07.406030 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-578b9ab0-ff12-446b-bb0d-6b1fb8b1ecd9 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:07.406767 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-578b9ab0-ff12-446b-bb0d-6b1fb8b1ecd9 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:07.446700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.network.neutron [None req-24c43ce2-0a40-440b-852f-3fe8fff0e56a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] validate_networks() for [('1b803e73-7491-4f9c-b808-c7c452f92be3', None, None, None, None, None)] {{(pid=118132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:21:07.608308 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-578b9ab0-ff12-446b-bb0d-6b1fb8b1ecd9 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:07.616888 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-578b9ab0-ff12-446b-bb0d-6b1fb8b1ecd9 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1502 microversion: 2.1 time: 0.238485 Aug 01 14:21:07.617600 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 61/120] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:07 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1502 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:07.736499 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b9aeedb0-d728-415e-8e04-071b9c8100fc tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:07.737485 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b9aeedb0-d728-415e-8e04-071b9c8100fc tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:07.747118 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b9aeedb0-d728-415e-8e04-071b9c8100fc tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:07.748467 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b9aeedb0-d728-415e-8e04-071b9c8100fc tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:07.749416 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b9aeedb0-d728-415e-8e04-071b9c8100fc tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:07.749953 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b9aeedb0-d728-415e-8e04-071b9c8100fc tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:08.089279 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b9aeedb0-d728-415e-8e04-071b9c8100fc tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:08.115224 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b9aeedb0-d728-415e-8e04-071b9c8100fc tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1366 microversion: 2.1 time: 0.383275 Aug 01 14:21:08.115403 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-24c43ce2-0a40-440b-852f-3fe8fff0e56a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Flavor limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:21:08.115908 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-24c43ce2-0a40-440b-852f-3fe8fff0e56a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Image limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:21:08.116521 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-24c43ce2-0a40-440b-852f-3fe8fff0e56a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Flavor pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:21:08.116637 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 62/121] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:07 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1366 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:08.127315 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-24c43ce2-0a40-440b-852f-3fe8fff0e56a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Image pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:21:08.127780 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-24c43ce2-0a40-440b-852f-3fe8fff0e56a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:21:08.127896 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a3a60c31-00b6-48f8-b948-84a7e9f17b3d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:08.129232 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a3a60c31-00b6-48f8-b948-84a7e9f17b3d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:08.159533 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a3a60c31-00b6-48f8-b948-84a7e9f17b3d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:08.162822 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a3a60c31-00b6-48f8-b948-84a7e9f17b3d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:08.163998 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a3a60c31-00b6-48f8-b948-84a7e9f17b3d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:08.164656 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a3a60c31-00b6-48f8-b948-84a7e9f17b3d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:08.167930 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-24c43ce2-0a40-440b-852f-3fe8fff0e56a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:08.168808 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-24c43ce2-0a40-440b-852f-3fe8fff0e56a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:08.169650 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-24c43ce2-0a40-440b-852f-3fe8fff0e56a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:08.170089 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-24c43ce2-0a40-440b-852f-3fe8fff0e56a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:08.227231 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-24c43ce2-0a40-440b-852f-3fe8fff0e56a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Getting quotas for project 486a69a51709439aad36192aece6133e. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:21:08.245190 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-24c43ce2-0a40-440b-852f-3fe8fff0e56a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Getting quotas for user 0f6938e54a8d49a6b00d3a6694d4e57f and project 486a69a51709439aad36192aece6133e. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:21:08.271844 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-24c43ce2-0a40-440b-852f-3fe8fff0e56a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Going to run 1 instances... {{(pid=118132) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:21:08.274560 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-24c43ce2-0a40-440b-852f-3fe8fff0e56a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:21:08.330370 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-24c43ce2-0a40-440b-852f-3fe8fff0e56a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.970487 Aug 01 14:21:08.331719 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 60/122] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Aug 1 14:21:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:21:08.344567 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-64b32d64-9121-4f2b-82ba-d77a9eab9f36 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:08.345188 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-64b32d64-9121-4f2b-82ba-d77a9eab9f36 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:08.396461 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a3a60c31-00b6-48f8-b948-84a7e9f17b3d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:08.405531 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a3a60c31-00b6-48f8-b948-84a7e9f17b3d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:08.407377 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a3a60c31-00b6-48f8-b948-84a7e9f17b3d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:08.408554 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a3a60c31-00b6-48f8-b948-84a7e9f17b3d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1407 microversion: 2.20 time: 0.288354 Aug 01 14:21:08.423324 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 63/123] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:08 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1407 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:21:08.657159 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-64b32d64-9121-4f2b-82ba-d77a9eab9f36 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:08.665959 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-64b32d64-9121-4f2b-82ba-d77a9eab9f36 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4" status: 200 len: 1218 microversion: 2.1 time: 0.326520 Aug 01 14:21:08.666856 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 61/124] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:08 2022] GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 => generated 1218 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:09.153886 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b1dfbd1d-d88c-43fb-9f48-2c7fc2350666 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:09.154450 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b1dfbd1d-d88c-43fb-9f48-2c7fc2350666 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:09.162820 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b1dfbd1d-d88c-43fb-9f48-2c7fc2350666 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:09.163622 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b1dfbd1d-d88c-43fb-9f48-2c7fc2350666 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:09.166209 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b1dfbd1d-d88c-43fb-9f48-2c7fc2350666 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:09.166591 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b1dfbd1d-d88c-43fb-9f48-2c7fc2350666 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:09.223410 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f32dd5e9-80be-4f21-ad78-1848b4518d86 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e8e7f0d-704c-4b2e-a37c-0d63117106bc"}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:09.226043 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f32dd5e9-80be-4f21-ad78-1848b4518d86 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:09.233603 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f32dd5e9-80be-4f21-ad78-1848b4518d86 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:09.234050 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f32dd5e9-80be-4f21-ad78-1848b4518d86 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:09.234974 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f32dd5e9-80be-4f21-ad78-1848b4518d86 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:09.235859 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f32dd5e9-80be-4f21-ad78-1848b4518d86 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:09.299811 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=100 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:09.331613 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b1dfbd1d-d88c-43fb-9f48-2c7fc2350666 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:09.340995 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b1dfbd1d-d88c-43fb-9f48-2c7fc2350666 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1366 microversion: 2.1 time: 0.191705 Aug 01 14:21:09.355269 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 64/125] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:09 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:09.434231 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-2619ed21-b86e-49eb-94a2-79e58fa1ab86 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:09.435918 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-2619ed21-b86e-49eb-94a2-79e58fa1ab86 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:09.448464 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2619ed21-b86e-49eb-94a2-79e58fa1ab86 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:09.449387 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2619ed21-b86e-49eb-94a2-79e58fa1ab86 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:09.450669 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2619ed21-b86e-49eb-94a2-79e58fa1ab86 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:09.451298 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2619ed21-b86e-49eb-94a2-79e58fa1ab86 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:09.659273 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2619ed21-b86e-49eb-94a2-79e58fa1ab86 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:09.671684 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2619ed21-b86e-49eb-94a2-79e58fa1ab86 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:09.674666 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2619ed21-b86e-49eb-94a2-79e58fa1ab86 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:09.677191 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-2619ed21-b86e-49eb-94a2-79e58fa1ab86 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1599 microversion: 2.20 time: 0.248102 Aug 01 14:21:09.691539 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 65/126] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:09 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1599 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:21:09.697799 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-35761549-9186-4ff4-b06c-a457b5503df7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:09.698539 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-35761549-9186-4ff4-b06c-a457b5503df7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:09.706919 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-35761549-9186-4ff4-b06c-a457b5503df7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:09.707557 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-35761549-9186-4ff4-b06c-a457b5503df7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:09.708496 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-35761549-9186-4ff4-b06c-a457b5503df7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:09.709306 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-35761549-9186-4ff4-b06c-a457b5503df7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:09.787944 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-35761549-9186-4ff4-b06c-a457b5503df7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:09.796262 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f32dd5e9-80be-4f21-ad78-1848b4518d86 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "POST /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.577608 Aug 01 14:21:09.799946 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-35761549-9186-4ff4-b06c-a457b5503df7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4" status: 200 len: 1270 microversion: 2.1 time: 0.106649 Aug 01 14:21:09.801532 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 66/127] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:09 2022] GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 => generated 1270 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:09.804845 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 62/128] 10.222.0.17 () {60 vars in 1323 bytes} [Mon Aug 1 14:21:09 2022] POST /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8/os-volume_attachments => generated 194 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:21:09.823562 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a6fd9c12-63d6-42a3-9d7e-bbb8767b6069 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:09.824100 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a6fd9c12-63d6-42a3-9d7e-bbb8767b6069 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:09.831995 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a6fd9c12-63d6-42a3-9d7e-bbb8767b6069 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:09.832451 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a6fd9c12-63d6-42a3-9d7e-bbb8767b6069 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:09.834186 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a6fd9c12-63d6-42a3-9d7e-bbb8767b6069 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:09.834781 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a6fd9c12-63d6-42a3-9d7e-bbb8767b6069 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:09.993242 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a6fd9c12-63d6-42a3-9d7e-bbb8767b6069 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.190287 Aug 01 14:21:09.993841 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 67/129] 10.222.0.17 () {60 vars in 1316 bytes} [Mon Aug 1 14:21:09 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680/os-interface => generated 284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:21:10.377017 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-620c69b2-0fcd-4020-b9fe-c8f9f424424d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:10.378693 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-620c69b2-0fcd-4020-b9fe-c8f9f424424d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:10.386903 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-620c69b2-0fcd-4020-b9fe-c8f9f424424d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:10.387722 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-620c69b2-0fcd-4020-b9fe-c8f9f424424d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:10.388964 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-620c69b2-0fcd-4020-b9fe-c8f9f424424d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:10.391075 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-620c69b2-0fcd-4020-b9fe-c8f9f424424d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:10.829245 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-26ce9385-e7e7-47f4-aedc-1508eb262ab6 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:10.830041 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-26ce9385-e7e7-47f4-aedc-1508eb262ab6 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:10.838571 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-26ce9385-e7e7-47f4-aedc-1508eb262ab6 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:10.839245 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-26ce9385-e7e7-47f4-aedc-1508eb262ab6 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:10.839902 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-26ce9385-e7e7-47f4-aedc-1508eb262ab6 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:10.840324 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-26ce9385-e7e7-47f4-aedc-1508eb262ab6 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:10.841402 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-620c69b2-0fcd-4020-b9fe-c8f9f424424d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:10.864979 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-620c69b2-0fcd-4020-b9fe-c8f9f424424d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1556 microversion: 2.1 time: 0.505986 Aug 01 14:21:10.866807 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 63/130] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:10 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1556 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:10.893515 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-808d31ad-5eed-4571-ac0d-f3333a7df058 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:10.894485 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-808d31ad-5eed-4571-ac0d-f3333a7df058 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:10.916277 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-808d31ad-5eed-4571-ac0d-f3333a7df058 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:10.917877 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-808d31ad-5eed-4571-ac0d-f3333a7df058 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:10.919096 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-808d31ad-5eed-4571-ac0d-f3333a7df058 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:10.920927 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-808d31ad-5eed-4571-ac0d-f3333a7df058 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:11.005981 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-26ce9385-e7e7-47f4-aedc-1508eb262ab6 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:11.018741 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-26ce9385-e7e7-47f4-aedc-1508eb262ab6 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4" status: 200 len: 1278 microversion: 2.1 time: 0.190708 Aug 01 14:21:11.038583 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 68/131] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:10 2022] GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 => generated 1278 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:11.203836 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-808d31ad-5eed-4571-ac0d-f3333a7df058 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.314306 Aug 01 14:21:11.204590 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 64/132] 10.222.0.17 () {58 vars in 1275 bytes} [Mon Aug 1 14:21:10 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711/os-interface => generated 285 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:21:12.046033 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-4e639715-f2e7-497c-924e-95cc9e9b3555 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:12.046768 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-4e639715-f2e7-497c-924e-95cc9e9b3555 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:12.056124 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4e639715-f2e7-497c-924e-95cc9e9b3555 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:12.057741 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4e639715-f2e7-497c-924e-95cc9e9b3555 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:12.058693 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4e639715-f2e7-497c-924e-95cc9e9b3555 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:12.059949 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4e639715-f2e7-497c-924e-95cc9e9b3555 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:12.404715 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4e639715-f2e7-497c-924e-95cc9e9b3555 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:12.411199 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-4e639715-f2e7-497c-924e-95cc9e9b3555 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4" status: 200 len: 1318 microversion: 2.1 time: 0.369453 Aug 01 14:21:12.422737 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 69/133] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:12 2022] GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:13.025481 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-fa1745f5-60ba-4f6c-abb2-17b514b7b74a req-ec60640a-b698-4d3e-9b3e-751a0ef1c84d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4345a2fe-05f1-4129-84c7-0bc44c0fdff4", "tag": "2a8ab380-8d50-4bde-acfd-f07858043d9e"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:13.047627 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-fa1745f5-60ba-4f6c-abb2-17b514b7b74a req-ec60640a-b698-4d3e-9b3e-751a0ef1c84d service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:13.048070 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-fa1745f5-60ba-4f6c-abb2-17b514b7b74a req-ec60640a-b698-4d3e-9b3e-751a0ef1c84d service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:13.077016 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-fa1745f5-60ba-4f6c-abb2-17b514b7b74a req-ec60640a-b698-4d3e-9b3e-751a0ef1c84d service nova] Creating event network-changed:2a8ab380-8d50-4bde-acfd-f07858043d9e for instance 4345a2fe-05f1-4129-84c7-0bc44c0fdff4 on hv-cinder-84599 Aug 01 14:21:13.085576 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-fa1745f5-60ba-4f6c-abb2-17b514b7b74a req-ec60640a-b698-4d3e-9b3e-751a0ef1c84d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063899 Aug 01 14:21:13.087677 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 65/134] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:21:13.287416 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-eca79d92-aa56-4ddf-bae0-e32254bd5388 req-80ea91cb-729a-4bdc-8f51-dc7cd2323571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76deb7da-88aa-4c26-b55d-fd6432d1e680", "tag": "e905a309-fe29-4762-880d-f6eb375da04f"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:13.306404 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-eca79d92-aa56-4ddf-bae0-e32254bd5388 req-80ea91cb-729a-4bdc-8f51-dc7cd2323571 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:13.307505 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-eca79d92-aa56-4ddf-bae0-e32254bd5388 req-80ea91cb-729a-4bdc-8f51-dc7cd2323571 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:13.334760 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-eca79d92-aa56-4ddf-bae0-e32254bd5388 req-80ea91cb-729a-4bdc-8f51-dc7cd2323571 service nova] Creating event network-changed:e905a309-fe29-4762-880d-f6eb375da04f for instance 76deb7da-88aa-4c26-b55d-fd6432d1e680 on hv-cinder-84599 Aug 01 14:21:13.335714 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-eca79d92-aa56-4ddf-bae0-e32254bd5388 req-80ea91cb-729a-4bdc-8f51-dc7cd2323571 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 01 14:21:13.337077 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c67c996b-022a-4cbd-8645-1bdab481f0b5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:13.337728 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c67c996b-022a-4cbd-8645-1bdab481f0b5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:13.338768 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c67c996b-022a-4cbd-8645-1bdab481f0b5 None None] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:13.339409 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c67c996b-022a-4cbd-8645-1bdab481f0b5 None None] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:13.350499 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.compute.rpcapi [None req-c67c996b-022a-4cbd-8645-1bdab481f0b5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 01 14:21:13.351781 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c67c996b-022a-4cbd-8645-1bdab481f0b5 None None] Releasing lock "compute-rpcapi-router" {{(pid=118133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 01 14:21:13.390706 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c67c996b-022a-4cbd-8645-1bdab481f0b5 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111059 Aug 01 14:21:13.391963 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 70/135] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:21:13.445721 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-fb3394cc-9b63-4bfb-8ae4-4685db96e878 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:13.446604 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-fb3394cc-9b63-4bfb-8ae4-4685db96e878 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:13.461488 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fb3394cc-9b63-4bfb-8ae4-4685db96e878 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:13.463409 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fb3394cc-9b63-4bfb-8ae4-4685db96e878 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:13.464761 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fb3394cc-9b63-4bfb-8ae4-4685db96e878 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:13.466919 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fb3394cc-9b63-4bfb-8ae4-4685db96e878 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:14.137763 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-fb3394cc-9b63-4bfb-8ae4-4685db96e878 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:14.150448 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-fb3394cc-9b63-4bfb-8ae4-4685db96e878 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4" status: 200 len: 1318 microversion: 2.1 time: 0.710226 Aug 01 14:21:14.153785 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 66/136] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:13 2022] GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 => generated 1318 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:15.176249 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-aa20bfd1-cc4a-405f-b8da-18001bcb5e68 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:15.177586 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-aa20bfd1-cc4a-405f-b8da-18001bcb5e68 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:15.195273 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=74 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:15.197585 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa20bfd1-cc4a-405f-b8da-18001bcb5e68 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:15.198300 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa20bfd1-cc4a-405f-b8da-18001bcb5e68 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:15.199874 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa20bfd1-cc4a-405f-b8da-18001bcb5e68 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:15.200490 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa20bfd1-cc4a-405f-b8da-18001bcb5e68 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:15.428814 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-87efe211-e157-4321-b9b0-948bee19ccf7 req-d738f893-d849-42db-b04a-17c88a4afb66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdb50660-a83d-4b80-9be9-f1c264f3d711", "tag": "549718cd-576c-4fb6-9df8-7e4cef065b1b"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:15.480833 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-87efe211-e157-4321-b9b0-948bee19ccf7 req-d738f893-d849-42db-b04a-17c88a4afb66 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:15.481498 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-87efe211-e157-4321-b9b0-948bee19ccf7 req-d738f893-d849-42db-b04a-17c88a4afb66 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:15.510671 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-87efe211-e157-4321-b9b0-948bee19ccf7 req-d738f893-d849-42db-b04a-17c88a4afb66 service nova] Creating event network-changed:549718cd-576c-4fb6-9df8-7e4cef065b1b for instance fdb50660-a83d-4b80-9be9-f1c264f3d711 on hv-cinder-84599 Aug 01 14:21:15.520239 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-87efe211-e157-4321-b9b0-948bee19ccf7 req-d738f893-d849-42db-b04a-17c88a4afb66 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096943 Aug 01 14:21:15.530052 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 67/137] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:21:15.723506 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-aa20bfd1-cc4a-405f-b8da-18001bcb5e68 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:15.732274 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-aa20bfd1-cc4a-405f-b8da-18001bcb5e68 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4" status: 200 len: 1318 microversion: 2.1 time: 0.561611 Aug 01 14:21:15.736748 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 71/138] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:15 2022] GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 => generated 1318 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:16.764340 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-689e9baf-ed7e-4b89-9d30-49d25b2d4ced tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:16.765168 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-689e9baf-ed7e-4b89-9d30-49d25b2d4ced tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:16.785100 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-689e9baf-ed7e-4b89-9d30-49d25b2d4ced tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:16.786639 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-689e9baf-ed7e-4b89-9d30-49d25b2d4ced tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:16.787734 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-689e9baf-ed7e-4b89-9d30-49d25b2d4ced tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:16.789110 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-689e9baf-ed7e-4b89-9d30-49d25b2d4ced tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:17.055926 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-689e9baf-ed7e-4b89-9d30-49d25b2d4ced tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:17.066761 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-689e9baf-ed7e-4b89-9d30-49d25b2d4ced tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4" status: 200 len: 1318 microversion: 2.1 time: 0.307079 Aug 01 14:21:17.079486 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 68/139] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:16 2022] GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:18.091328 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e99dca7f-da2c-49ba-b194-a8f50c183003 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:18.091967 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e99dca7f-da2c-49ba-b194-a8f50c183003 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:18.101087 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e99dca7f-da2c-49ba-b194-a8f50c183003 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:18.106896 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e99dca7f-da2c-49ba-b194-a8f50c183003 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:18.108066 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e99dca7f-da2c-49ba-b194-a8f50c183003 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:18.110369 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e99dca7f-da2c-49ba-b194-a8f50c183003 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:18.299851 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e99dca7f-da2c-49ba-b194-a8f50c183003 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:18.304035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=100 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:18.310306 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e99dca7f-da2c-49ba-b194-a8f50c183003 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4" status: 200 len: 1318 microversion: 2.1 time: 0.224285 Aug 01 14:21:18.323649 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 72/140] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:18 2022] GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:19.333205 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a156ae55-e2e7-4862-b75f-ac606616cec7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:19.333929 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a156ae55-e2e7-4862-b75f-ac606616cec7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:19.337111 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=2 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:19.337958 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=8 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:19.345911 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a156ae55-e2e7-4862-b75f-ac606616cec7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:19.346361 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a156ae55-e2e7-4862-b75f-ac606616cec7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:19.348214 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a156ae55-e2e7-4862-b75f-ac606616cec7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:19.348815 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a156ae55-e2e7-4862-b75f-ac606616cec7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:19.513484 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a156ae55-e2e7-4862-b75f-ac606616cec7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:19.522090 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a156ae55-e2e7-4862-b75f-ac606616cec7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4" status: 200 len: 1318 microversion: 2.1 time: 0.193584 Aug 01 14:21:19.522671 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 69/141] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:19 2022] GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:20.014616 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-e876435d-b92b-4e0f-acd0-de8158baaf1a req-82ebee2d-a9b0-4232-8631-1d2d73328195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4345a2fe-05f1-4129-84c7-0bc44c0fdff4", "name": "network-vif-plugged", "status": "completed", "tag": "2a8ab380-8d50-4bde-acfd-f07858043d9e"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:20.033959 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-e876435d-b92b-4e0f-acd0-de8158baaf1a req-82ebee2d-a9b0-4232-8631-1d2d73328195 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:20.035074 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-e876435d-b92b-4e0f-acd0-de8158baaf1a req-82ebee2d-a9b0-4232-8631-1d2d73328195 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:20.048843 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-e876435d-b92b-4e0f-acd0-de8158baaf1a req-82ebee2d-a9b0-4232-8631-1d2d73328195 service nova] Creating event network-vif-plugged:2a8ab380-8d50-4bde-acfd-f07858043d9e for instance 4345a2fe-05f1-4129-84c7-0bc44c0fdff4 on hv-cinder-84599 Aug 01 14:21:20.056680 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-e876435d-b92b-4e0f-acd0-de8158baaf1a req-82ebee2d-a9b0-4232-8631-1d2d73328195 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045511 Aug 01 14:21:20.057983 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 73/142] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:21:20.243266 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d11e9f2c-f028-431a-abd6-a9e8c3a1fa4d tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:20.243804 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d11e9f2c-f028-431a-abd6-a9e8c3a1fa4d tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:20.251266 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:20.253056 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d11e9f2c-f028-431a-abd6-a9e8c3a1fa4d tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:20.253697 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d11e9f2c-f028-431a-abd6-a9e8c3a1fa4d tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:20.254727 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d11e9f2c-f028-431a-abd6-a9e8c3a1fa4d tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:20.255353 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d11e9f2c-f028-431a-abd6-a9e8c3a1fa4d tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:20.301279 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d11e9f2c-f028-431a-abd6-a9e8c3a1fa4d tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Going to try to terminate instance {{(pid=118132) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:21:20.429729 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d11e9f2c-f028-431a-abd6-a9e8c3a1fa4d tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 204 len: 0 microversion: 2.1 time: 0.190110 Aug 01 14:21:20.430431 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 70/143] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Aug 1 14:21:20 2022] DELETE /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:21:20.438684 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f447974c-8570-4867-afb1-13f842ae4ecf tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:20.439370 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f447974c-8570-4867-afb1-13f842ae4ecf tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:20.446249 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f447974c-8570-4867-afb1-13f842ae4ecf tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:20.446688 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f447974c-8570-4867-afb1-13f842ae4ecf tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:20.447438 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f447974c-8570-4867-afb1-13f842ae4ecf tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:20.447891 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f447974c-8570-4867-afb1-13f842ae4ecf tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:20.545746 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-34f4eee1-5358-4ccc-a79e-abf923dd6de2 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:20.546799 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-34f4eee1-5358-4ccc-a79e-abf923dd6de2 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:20.554231 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-34f4eee1-5358-4ccc-a79e-abf923dd6de2 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:20.555029 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-34f4eee1-5358-4ccc-a79e-abf923dd6de2 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:20.555913 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-34f4eee1-5358-4ccc-a79e-abf923dd6de2 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:20.556351 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-34f4eee1-5358-4ccc-a79e-abf923dd6de2 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:20.618820 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f447974c-8570-4867-afb1-13f842ae4ecf tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:20.629099 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f447974c-8570-4867-afb1-13f842ae4ecf tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1554 microversion: 2.1 time: 0.194440 Aug 01 14:21:20.629786 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 74/144] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:20 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1554 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:20.716557 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-34f4eee1-5358-4ccc-a79e-abf923dd6de2 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:20.724469 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-34f4eee1-5358-4ccc-a79e-abf923dd6de2 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4" status: 200 len: 1318 microversion: 2.1 time: 0.183400 Aug 01 14:21:20.725042 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 71/145] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:20 2022] GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:21.652660 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a3ab422e-c57c-46bd-b5e2-7805ecfa02d3 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:21.653350 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a3ab422e-c57c-46bd-b5e2-7805ecfa02d3 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:21.666938 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a3ab422e-c57c-46bd-b5e2-7805ecfa02d3 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:21.667379 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a3ab422e-c57c-46bd-b5e2-7805ecfa02d3 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:21.668182 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a3ab422e-c57c-46bd-b5e2-7805ecfa02d3 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:21.668605 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a3ab422e-c57c-46bd-b5e2-7805ecfa02d3 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:21.746011 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-479e4e38-00f7-4982-bf7a-4c322efbcb42 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:21.746816 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-479e4e38-00f7-4982-bf7a-4c322efbcb42 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:21.754315 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-479e4e38-00f7-4982-bf7a-4c322efbcb42 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:21.754853 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-479e4e38-00f7-4982-bf7a-4c322efbcb42 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:21.755776 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-479e4e38-00f7-4982-bf7a-4c322efbcb42 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:21.756271 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-479e4e38-00f7-4982-bf7a-4c322efbcb42 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:21.823701 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a3ab422e-c57c-46bd-b5e2-7805ecfa02d3 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:21.833670 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a3ab422e-c57c-46bd-b5e2-7805ecfa02d3 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1554 microversion: 2.1 time: 0.186314 Aug 01 14:21:21.834585 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 75/146] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:21 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1554 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:21.905441 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-479e4e38-00f7-4982-bf7a-4c322efbcb42 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:21.913415 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-479e4e38-00f7-4982-bf7a-4c322efbcb42 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4" status: 200 len: 1318 microversion: 2.1 time: 0.171239 Aug 01 14:21:21.913985 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 72/147] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:21 2022] GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:22.855720 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-33c9fd81-0072-4090-8dcf-ac0580e49516 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:22.856331 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-33c9fd81-0072-4090-8dcf-ac0580e49516 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:22.862978 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-33c9fd81-0072-4090-8dcf-ac0580e49516 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:22.863417 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-33c9fd81-0072-4090-8dcf-ac0580e49516 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:22.864202 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-33c9fd81-0072-4090-8dcf-ac0580e49516 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:22.864635 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-33c9fd81-0072-4090-8dcf-ac0580e49516 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:22.934186 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f5e4b658-ffd6-4d09-8524-2b01984dd548 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:22.934851 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f5e4b658-ffd6-4d09-8524-2b01984dd548 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:22.941766 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f5e4b658-ffd6-4d09-8524-2b01984dd548 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:22.942214 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f5e4b658-ffd6-4d09-8524-2b01984dd548 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:22.942975 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f5e4b658-ffd6-4d09-8524-2b01984dd548 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:22.943402 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f5e4b658-ffd6-4d09-8524-2b01984dd548 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:22.997402 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-33c9fd81-0072-4090-8dcf-ac0580e49516 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:23.006835 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-33c9fd81-0072-4090-8dcf-ac0580e49516 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1554 microversion: 2.1 time: 0.154514 Aug 01 14:21:23.007630 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 76/148] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:22 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:23.080634 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f5e4b658-ffd6-4d09-8524-2b01984dd548 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:23.088646 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f5e4b658-ffd6-4d09-8524-2b01984dd548 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4" status: 200 len: 1318 microversion: 2.1 time: 0.158349 Aug 01 14:21:23.089214 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 73/149] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:22 2022] GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:24.030157 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e6a1b032-b8bf-4791-a002-4e4f36bbe7bc tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:24.030763 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e6a1b032-b8bf-4791-a002-4e4f36bbe7bc tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:24.036235 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:24.038385 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e6a1b032-b8bf-4791-a002-4e4f36bbe7bc tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:24.038877 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e6a1b032-b8bf-4791-a002-4e4f36bbe7bc tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:24.039782 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e6a1b032-b8bf-4791-a002-4e4f36bbe7bc tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:24.040212 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e6a1b032-b8bf-4791-a002-4e4f36bbe7bc tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:24.110737 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8c2cf28c-1102-4310-a2a3-919ec39d9e42 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:24.112145 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-8c2cf28c-1102-4310-a2a3-919ec39d9e42 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:24.128465 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8c2cf28c-1102-4310-a2a3-919ec39d9e42 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:24.129098 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8c2cf28c-1102-4310-a2a3-919ec39d9e42 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:24.130075 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8c2cf28c-1102-4310-a2a3-919ec39d9e42 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:24.130513 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8c2cf28c-1102-4310-a2a3-919ec39d9e42 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:24.205472 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e6a1b032-b8bf-4791-a002-4e4f36bbe7bc tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:24.214452 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e6a1b032-b8bf-4791-a002-4e4f36bbe7bc tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1554 microversion: 2.1 time: 0.188167 Aug 01 14:21:24.215234 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 77/150] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:24 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1554 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:24.301135 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-8c2cf28c-1102-4310-a2a3-919ec39d9e42 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:24.305835 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8c2cf28c-1102-4310-a2a3-919ec39d9e42 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4" status: 200 len: 1318 microversion: 2.1 time: 0.199228 Aug 01 14:21:24.306501 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 74/151] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:24 2022] GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:25.238734 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e67c4230-b887-4a6a-95b1-ab5076809a05 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:25.239691 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e67c4230-b887-4a6a-95b1-ab5076809a05 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:25.246174 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e67c4230-b887-4a6a-95b1-ab5076809a05 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:25.246623 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e67c4230-b887-4a6a-95b1-ab5076809a05 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:25.247389 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e67c4230-b887-4a6a-95b1-ab5076809a05 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:25.247847 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e67c4230-b887-4a6a-95b1-ab5076809a05 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:25.327209 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e2415a10-eb9c-49b3-9117-8e7296c59a76 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:25.327973 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e2415a10-eb9c-49b3-9117-8e7296c59a76 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:25.335547 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e2415a10-eb9c-49b3-9117-8e7296c59a76 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:25.336075 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e2415a10-eb9c-49b3-9117-8e7296c59a76 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:25.336906 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e2415a10-eb9c-49b3-9117-8e7296c59a76 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:25.337429 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e2415a10-eb9c-49b3-9117-8e7296c59a76 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:25.397775 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e67c4230-b887-4a6a-95b1-ab5076809a05 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:25.406998 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e67c4230-b887-4a6a-95b1-ab5076809a05 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1554 microversion: 2.1 time: 0.172651 Aug 01 14:21:25.407803 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 78/152] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:25 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:25.491407 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e2415a10-eb9c-49b3-9117-8e7296c59a76 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:25.498851 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e2415a10-eb9c-49b3-9117-8e7296c59a76 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4" status: 200 len: 1318 microversion: 2.1 time: 0.175866 Aug 01 14:21:25.499416 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 75/153] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:25 2022] GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:26.428070 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ef98bc63-b5b1-4fd2-a144-de0e3d9f6504 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:26.428718 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ef98bc63-b5b1-4fd2-a144-de0e3d9f6504 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:26.434819 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ef98bc63-b5b1-4fd2-a144-de0e3d9f6504 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:26.435265 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ef98bc63-b5b1-4fd2-a144-de0e3d9f6504 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:26.436066 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ef98bc63-b5b1-4fd2-a144-de0e3d9f6504 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:26.436500 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ef98bc63-b5b1-4fd2-a144-de0e3d9f6504 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:26.521446 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8d604900-0453-4c76-9a8c-ce99acf6f163 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:26.522382 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-8d604900-0453-4c76-9a8c-ce99acf6f163 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:26.529943 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8d604900-0453-4c76-9a8c-ce99acf6f163 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:26.530518 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8d604900-0453-4c76-9a8c-ce99acf6f163 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:26.531380 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8d604900-0453-4c76-9a8c-ce99acf6f163 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:26.531901 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8d604900-0453-4c76-9a8c-ce99acf6f163 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:26.573870 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ef98bc63-b5b1-4fd2-a144-de0e3d9f6504 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:26.583324 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ef98bc63-b5b1-4fd2-a144-de0e3d9f6504 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1554 microversion: 2.1 time: 0.159658 Aug 01 14:21:26.584028 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 79/154] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:26 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:26.678019 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-8d604900-0453-4c76-9a8c-ce99acf6f163 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:26.687483 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8d604900-0453-4c76-9a8c-ce99acf6f163 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4" status: 200 len: 1318 microversion: 2.1 time: 0.170154 Aug 01 14:21:26.688202 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 76/155] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:26 2022] GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:27.552674 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-db950e9b-7b7e-4637-9e01-39013d83dc61 req-e9d1d611-8e3b-4bf9-bbe6-3d6ca93237ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6574d506-2cc2-4d16-87d3-eefee1edb1e8", "name": "network-vif-deleted", "tag": "b4ee4c3d-69b1-4db4-b0f0-968da4c540a8"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:27.573026 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-db950e9b-7b7e-4637-9e01-39013d83dc61 req-e9d1d611-8e3b-4bf9-bbe6-3d6ca93237ff service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:27.573715 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-db950e9b-7b7e-4637-9e01-39013d83dc61 req-e9d1d611-8e3b-4bf9-bbe6-3d6ca93237ff service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:27.588665 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-db950e9b-7b7e-4637-9e01-39013d83dc61 req-e9d1d611-8e3b-4bf9-bbe6-3d6ca93237ff service nova] Creating event network-vif-deleted:b4ee4c3d-69b1-4db4-b0f0-968da4c540a8 for instance 6574d506-2cc2-4d16-87d3-eefee1edb1e8 on hv-cinder-84599 Aug 01 14:21:27.594208 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-db950e9b-7b7e-4637-9e01-39013d83dc61 req-e9d1d611-8e3b-4bf9-bbe6-3d6ca93237ff service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054276 Aug 01 14:21:27.595265 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 80/156] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:21:27.611427 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6eba3577-612b-4c0c-bd0a-916e5c6f5762 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:27.612970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-6eba3577-612b-4c0c-bd0a-916e5c6f5762 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:27.635901 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6eba3577-612b-4c0c-bd0a-916e5c6f5762 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:27.636536 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6eba3577-612b-4c0c-bd0a-916e5c6f5762 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:27.637941 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6eba3577-612b-4c0c-bd0a-916e5c6f5762 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:27.638640 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6eba3577-612b-4c0c-bd0a-916e5c6f5762 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:27.710456 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0af40db3-58f3-4e94-93c4-d289e8712b1e tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:27.711442 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0af40db3-58f3-4e94-93c4-d289e8712b1e tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:27.725362 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0af40db3-58f3-4e94-93c4-d289e8712b1e tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:27.725362 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0af40db3-58f3-4e94-93c4-d289e8712b1e tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:27.725362 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0af40db3-58f3-4e94-93c4-d289e8712b1e tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:27.725362 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0af40db3-58f3-4e94-93c4-d289e8712b1e tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:27.739303 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6eba3577-612b-4c0c-bd0a-916e5c6f5762 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd16d046c4df2a5dc99b43262375a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5632d6b304db99e66877b0c329714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:27.742891 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:27.749348 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6eba3577-612b-4c0c-bd0a-916e5c6f5762 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 200 len: 1346 microversion: 2.1 time: 0.147437 Aug 01 14:21:27.750263 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 77/157] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:27 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 1346 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:27.917296 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0af40db3-58f3-4e94-93c4-d289e8712b1e tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:27.927557 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0af40db3-58f3-4e94-93c4-d289e8712b1e tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4" status: 200 len: 1506 microversion: 2.1 time: 0.221787 Aug 01 14:21:27.940346 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 81/158] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:27 2022] GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 => generated 1506 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:28.773951 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9b8ba3a7-edd9-427f-bfa1-88c9c50d453b tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:28.774896 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9b8ba3a7-edd9-427f-bfa1-88c9c50d453b tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:28.782254 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9b8ba3a7-edd9-427f-bfa1-88c9c50d453b tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:28.782769 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9b8ba3a7-edd9-427f-bfa1-88c9c50d453b tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:28.783695 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9b8ba3a7-edd9-427f-bfa1-88c9c50d453b tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:28.784202 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9b8ba3a7-edd9-427f-bfa1-88c9c50d453b tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:28.807942 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-9b8ba3a7-edd9-427f-bfa1-88c9c50d453b tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] HTTP exception thrown: Instance 6574d506-2cc2-4d16-87d3-eefee1edb1e8 could not be found. Aug 01 14:21:28.813051 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9b8ba3a7-edd9-427f-bfa1-88c9c50d453b tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Request method failure captured: Aug 01 14:21:28.813051 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 HTTP/1.1 Aug 01 14:21:28.813051 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept: application/json Aug 01 14:21:28.813051 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Aug 01 14:21:28.813051 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Connection: close Aug 01 14:21:28.813051 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Length: 0 Aug 01 14:21:28.813051 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Type: application/json Aug 01 14:21:28.813051 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Host: 10.222.0.17 Aug 01 14:21:28.813051 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Aug 01 14:21:28.813051 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.10 Aug 01 14:21:28.813051 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABi5-ElWOEbc_qiGZWFBjpb0VYWoKO6wR0O55ZCYFTIMVhKZtbBGx33-dQ8EfRKp8Oks8YKqBtms0rJU2vMi-jFRhJPDSYtgJHfjE6cP4QKVe3rWbrmlVYhD-X5a5IsyFgeD-LkSWUB465Km6cnapu1uuPUmYSEeK7UR-Fj1ehiWuApCDg Aug 01 14:21:28.813051 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Aug 01 14:21:28.813051 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Aug 01 14:21:28.813051 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Aug 01 14:21:28.813051 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Aug 01 14:21:28.813051 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Aug 01 14:21:28.813051 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Aug 01 14:21:28.813051 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Id: b9f5632d6b304db99e66877b0c329714 Aug 01 14:21:28.813051 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-DeleteServersTestJSON-888830500 Aug 01 14:21:28.813051 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Role: reader,member Aug 01 14:21:28.813051 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Roles: reader,member Aug 01 14:21:28.814455 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b9f5632d6b304db99e66877b0c329714"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b9f5632d6b304db99e66877b0c329714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b9f5632d6b304db99e66877b0c329714"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b9f5632d6b304db99e66877b0c329714", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:21:28.814455 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-DeleteServersTestJSON-888830500 Aug 01 14:21:28.814455 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Id: b9f5632d6b304db99e66877b0c329714 Aug 01 14:21:28.814455 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-DeleteServersTestJSON-888830500 Aug 01 14:21:28.814455 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User: tempest-DeleteServersTestJSON-888830500-project Aug 01 14:21:28.814455 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Aug 01 14:21:28.814455 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Aug 01 14:21:28.814455 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Id: 67fcd16d046c4df2a5dc99b43262375a Aug 01 14:21:28.814455 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-DeleteServersTestJSON-888830500-project Aug 01 14:21:28.814455 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: method: > Aug 01 14:21:28.814455 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: exception: Instance 6574d506-2cc2-4d16-87d3-eefee1edb1e8 could not be found. Aug 01 14:21:28.814455 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: action_args: {'id': '6574d506-2cc2-4d16-87d3-eefee1edb1e8'} Aug 01 14:21:28.815134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:21:28.815134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:28.815134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:21:28.815134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:21:28.815134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:21:28.815134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:21:28.815134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:21:28.815134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:21:28.815134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:21:28.815134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:21:28.815134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6574d506-2cc2-4d16-87d3-eefee1edb1e8 could not be found. Aug 01 14:21:28.815134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:21:28.815134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:28.815134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:21:28.815134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:28.815134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:28.815134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:28.815134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:21:28.815134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:21:28.815134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:21:28.817833 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:21:28.817833 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:21:28.817833 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:21:28.817833 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:21:28.817833 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:21:28.817833 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:21:28.817833 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:21:28.817833 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6574d506-2cc2-4d16-87d3-eefee1edb1e8 could not be found. Aug 01 14:21:28.817833 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:21:28.817833 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:28.817833 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:21:28.817833 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:28.817833 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:28.817833 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:28.817833 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:21:28.817833 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:21:28.817833 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6574d506-2cc2-4d16-87d3-eefee1edb1e8 could not be found. Aug 01 14:21:28.817833 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:21:28.821511 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9b8ba3a7-edd9-427f-bfa1-88c9c50d453b tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Returning 404 to user: Instance 6574d506-2cc2-4d16-87d3-eefee1edb1e8 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:21:28.821511 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9b8ba3a7-edd9-427f-bfa1-88c9c50d453b tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 404 len: 111 microversion: 2.1 time: 0.048822 Aug 01 14:21:28.827587 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 78/159] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:28 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:21:28.939843 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9dcaf28e-867a-4d88-8468-8ecaab787902 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:28.942874 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9dcaf28e-867a-4d88-8468-8ecaab787902 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:28.953452 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9dcaf28e-867a-4d88-8468-8ecaab787902 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:28.953941 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9dcaf28e-867a-4d88-8468-8ecaab787902 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:28.954797 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9dcaf28e-867a-4d88-8468-8ecaab787902 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:28.955295 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9dcaf28e-867a-4d88-8468-8ecaab787902 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:28.971229 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-9dcaf28e-867a-4d88-8468-8ecaab787902 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] HTTP exception thrown: Instance 6574d506-2cc2-4d16-87d3-eefee1edb1e8 could not be found. Aug 01 14:21:28.980709 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9dcaf28e-867a-4d88-8468-8ecaab787902 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Request method failure captured: Aug 01 14:21:28.980709 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8/os-volume_attachments HTTP/1.1 Aug 01 14:21:28.980709 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:21:28.980709 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:21:28.980709 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:21:28.980709 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 0 Aug 01 14:21:28.980709 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:21:28.980709 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:21:28.980709 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:21:28.980709 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:21:28.980709 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-ElWOEbc_qiGZWFBjpb0VYWoKO6wR0O55ZCYFTIMVhKZtbBGx33-dQ8EfRKp8Oks8YKqBtms0rJU2vMi-jFRhJPDSYtgJHfjE6cP4QKVe3rWbrmlVYhD-X5a5IsyFgeD-LkSWUB465Km6cnapu1uuPUmYSEeK7UR-Fj1ehiWuApCDg Aug 01 14:21:28.980709 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:21:28.980709 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:21:28.980709 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:21:28.980709 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:21:28.980709 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:21:28.980709 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:21:28.980709 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: b9f5632d6b304db99e66877b0c329714 Aug 01 14:21:28.980709 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-DeleteServersTestJSON-888830500 Aug 01 14:21:28.980709 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:21:28.980709 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:21:28.981892 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b9f5632d6b304db99e66877b0c329714"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b9f5632d6b304db99e66877b0c329714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b9f5632d6b304db99e66877b0c329714"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b9f5632d6b304db99e66877b0c329714", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:21:28.981892 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-DeleteServersTestJSON-888830500 Aug 01 14:21:28.981892 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: b9f5632d6b304db99e66877b0c329714 Aug 01 14:21:28.981892 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-DeleteServersTestJSON-888830500 Aug 01 14:21:28.981892 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-DeleteServersTestJSON-888830500-project Aug 01 14:21:28.981892 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:21:28.981892 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:21:28.981892 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: 67fcd16d046c4df2a5dc99b43262375a Aug 01 14:21:28.981892 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-DeleteServersTestJSON-888830500-project Aug 01 14:21:28.981892 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: > Aug 01 14:21:28.981892 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Instance 6574d506-2cc2-4d16-87d3-eefee1edb1e8 could not be found. Aug 01 14:21:28.981892 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'server_id': '6574d506-2cc2-4d16-87d3-eefee1edb1e8'} Aug 01 14:21:28.982556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:21:28.982556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:28.982556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:21:28.982556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:21:28.982556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:21:28.982556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:21:28.982556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:21:28.982556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:21:28.982556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:21:28.982556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:21:28.982556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6574d506-2cc2-4d16-87d3-eefee1edb1e8 could not be found. Aug 01 14:21:28.982556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:21:28.982556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:28.982556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:21:28.982556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:28.982556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:28.982556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:28.982556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:21:28.982556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:21:28.982556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:21:28.983625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:21:28.983625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 01 14:21:28.983625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:21:28.983625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 01 14:21:28.983625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:21:28.983625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 01 14:21:28.983625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 01 14:21:28.983625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:21:28.983625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:21:28.983625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6574d506-2cc2-4d16-87d3-eefee1edb1e8 could not be found. Aug 01 14:21:28.983625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:21:28.983625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:28.983625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:21:28.983625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:28.983625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:28.983625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:28.983625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:21:28.983625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:21:28.983625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6574d506-2cc2-4d16-87d3-eefee1edb1e8 could not be found. Aug 01 14:21:28.983625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:21:28.986219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9dcaf28e-867a-4d88-8468-8ecaab787902 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Returning 404 to user: Instance 6574d506-2cc2-4d16-87d3-eefee1edb1e8 could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:21:28.987110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9dcaf28e-867a-4d88-8468-8ecaab787902 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.053190 Aug 01 14:21:28.988228 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 82/160] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Aug 1 14:21:28 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8/os-volume_attachments => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:21:30.247122 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3d88e3ab-2542-4515-9d4f-634518b44317 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:30.247646 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3d88e3ab-2542-4515-9d4f-634518b44317 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:30.255264 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3d88e3ab-2542-4515-9d4f-634518b44317 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:30.255920 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3d88e3ab-2542-4515-9d4f-634518b44317 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:30.256700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3d88e3ab-2542-4515-9d4f-634518b44317 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:30.257133 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3d88e3ab-2542-4515-9d4f-634518b44317 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:30.272114 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-3d88e3ab-2542-4515-9d4f-634518b44317 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] HTTP exception thrown: Instance 6574d506-2cc2-4d16-87d3-eefee1edb1e8 could not be found. Aug 01 14:21:30.273666 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3d88e3ab-2542-4515-9d4f-634518b44317 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Request method failure captured: Aug 01 14:21:30.273666 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: request: DELETE /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 HTTP/1.1 Aug 01 14:21:30.273666 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept: application/json Aug 01 14:21:30.273666 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Aug 01 14:21:30.273666 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Connection: close Aug 01 14:21:30.273666 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Length: 0 Aug 01 14:21:30.273666 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Type: application/json Aug 01 14:21:30.273666 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Host: 10.222.0.17 Aug 01 14:21:30.273666 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Aug 01 14:21:30.273666 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.10 Aug 01 14:21:30.273666 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABi5-ElWOEbc_qiGZWFBjpb0VYWoKO6wR0O55ZCYFTIMVhKZtbBGx33-dQ8EfRKp8Oks8YKqBtms0rJU2vMi-jFRhJPDSYtgJHfjE6cP4QKVe3rWbrmlVYhD-X5a5IsyFgeD-LkSWUB465Km6cnapu1uuPUmYSEeK7UR-Fj1ehiWuApCDg Aug 01 14:21:30.273666 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Aug 01 14:21:30.273666 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Aug 01 14:21:30.273666 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Aug 01 14:21:30.273666 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Aug 01 14:21:30.273666 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Aug 01 14:21:30.273666 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Aug 01 14:21:30.273666 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Id: b9f5632d6b304db99e66877b0c329714 Aug 01 14:21:30.273666 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-DeleteServersTestJSON-888830500 Aug 01 14:21:30.273666 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Role: reader,member Aug 01 14:21:30.273666 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Roles: reader,member Aug 01 14:21:30.275093 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b9f5632d6b304db99e66877b0c329714"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b9f5632d6b304db99e66877b0c329714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b9f5632d6b304db99e66877b0c329714"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b9f5632d6b304db99e66877b0c329714", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:21:30.275093 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-DeleteServersTestJSON-888830500 Aug 01 14:21:30.275093 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Id: b9f5632d6b304db99e66877b0c329714 Aug 01 14:21:30.275093 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-DeleteServersTestJSON-888830500 Aug 01 14:21:30.275093 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User: tempest-DeleteServersTestJSON-888830500-project Aug 01 14:21:30.275093 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Aug 01 14:21:30.275093 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Aug 01 14:21:30.275093 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Id: 67fcd16d046c4df2a5dc99b43262375a Aug 01 14:21:30.275093 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-DeleteServersTestJSON-888830500-project Aug 01 14:21:30.275093 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: method: > Aug 01 14:21:30.275093 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: exception: Instance 6574d506-2cc2-4d16-87d3-eefee1edb1e8 could not be found. Aug 01 14:21:30.275093 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: action_args: {'id': '6574d506-2cc2-4d16-87d3-eefee1edb1e8'} Aug 01 14:21:30.275888 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:21:30.275888 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:30.275888 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:21:30.275888 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:21:30.275888 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:21:30.275888 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:21:30.275888 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:21:30.275888 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:21:30.275888 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:21:30.275888 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:21:30.275888 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6574d506-2cc2-4d16-87d3-eefee1edb1e8 could not be found. Aug 01 14:21:30.275888 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:21:30.275888 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:30.275888 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:21:30.275888 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:30.275888 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:30.275888 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:30.275888 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:21:30.275888 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:21:30.275888 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:21:30.276937 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:21:30.276937 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:21:30.276937 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:21:30.276937 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:21:30.276937 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:21:30.276937 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:21:30.276937 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:21:30.276937 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:21:30.276937 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:21:30.276937 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6574d506-2cc2-4d16-87d3-eefee1edb1e8 could not be found. Aug 01 14:21:30.276937 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:21:30.276937 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:30.276937 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:21:30.276937 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:30.276937 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:30.276937 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:30.276937 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:21:30.276937 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:21:30.276937 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6574d506-2cc2-4d16-87d3-eefee1edb1e8 could not be found. Aug 01 14:21:30.276937 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:21:30.278902 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3d88e3ab-2542-4515-9d4f-634518b44317 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Returning 404 to user: Instance 6574d506-2cc2-4d16-87d3-eefee1edb1e8 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:21:30.279939 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3d88e3ab-2542-4515-9d4f-634518b44317 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 404 len: 111 microversion: 2.1 time: 0.036862 Aug 01 14:21:30.280646 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 79/161] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Aug 1 14:21:30 2022] DELETE /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:21:30.289088 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-754053ff-be1d-4b46-9d02-01d25778c8c5 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:30.289695 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-754053ff-be1d-4b46-9d02-01d25778c8c5 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] [instance: 6574d506-2cc2-4d16-87d3-eefee1edb1e8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:30.297495 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-754053ff-be1d-4b46-9d02-01d25778c8c5 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:30.298191 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-754053ff-be1d-4b46-9d02-01d25778c8c5 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:30.299252 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-754053ff-be1d-4b46-9d02-01d25778c8c5 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:30.299641 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-754053ff-be1d-4b46-9d02-01d25778c8c5 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:30.314985 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-754053ff-be1d-4b46-9d02-01d25778c8c5 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] HTTP exception thrown: Instance 6574d506-2cc2-4d16-87d3-eefee1edb1e8 could not be found. Aug 01 14:21:30.317730 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-754053ff-be1d-4b46-9d02-01d25778c8c5 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Request method failure captured: Aug 01 14:21:30.317730 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 HTTP/1.1 Aug 01 14:21:30.317730 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:21:30.317730 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:21:30.317730 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:21:30.317730 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 0 Aug 01 14:21:30.317730 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:21:30.317730 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:21:30.317730 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:21:30.317730 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:21:30.317730 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-ElWOEbc_qiGZWFBjpb0VYWoKO6wR0O55ZCYFTIMVhKZtbBGx33-dQ8EfRKp8Oks8YKqBtms0rJU2vMi-jFRhJPDSYtgJHfjE6cP4QKVe3rWbrmlVYhD-X5a5IsyFgeD-LkSWUB465Km6cnapu1uuPUmYSEeK7UR-Fj1ehiWuApCDg Aug 01 14:21:30.317730 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:21:30.317730 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:21:30.317730 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:21:30.317730 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:21:30.317730 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:21:30.317730 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:21:30.317730 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: b9f5632d6b304db99e66877b0c329714 Aug 01 14:21:30.317730 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-DeleteServersTestJSON-888830500 Aug 01 14:21:30.317730 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:21:30.317730 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:21:30.318853 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b9f5632d6b304db99e66877b0c329714"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b9f5632d6b304db99e66877b0c329714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b9f5632d6b304db99e66877b0c329714"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b9f5632d6b304db99e66877b0c329714", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:21:30.318853 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-DeleteServersTestJSON-888830500 Aug 01 14:21:30.318853 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: b9f5632d6b304db99e66877b0c329714 Aug 01 14:21:30.318853 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-DeleteServersTestJSON-888830500 Aug 01 14:21:30.318853 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-DeleteServersTestJSON-888830500-project Aug 01 14:21:30.318853 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:21:30.318853 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:21:30.318853 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: 67fcd16d046c4df2a5dc99b43262375a Aug 01 14:21:30.318853 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-DeleteServersTestJSON-888830500-project Aug 01 14:21:30.318853 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: > Aug 01 14:21:30.318853 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Instance 6574d506-2cc2-4d16-87d3-eefee1edb1e8 could not be found. Aug 01 14:21:30.318853 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'id': '6574d506-2cc2-4d16-87d3-eefee1edb1e8'} Aug 01 14:21:30.319497 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:21:30.319497 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:30.319497 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:21:30.319497 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:21:30.319497 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:21:30.319497 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:21:30.319497 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:21:30.319497 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:21:30.319497 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:21:30.319497 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:21:30.319497 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6574d506-2cc2-4d16-87d3-eefee1edb1e8 could not be found. Aug 01 14:21:30.319497 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:21:30.319497 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:30.319497 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:21:30.319497 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:30.319497 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:30.319497 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:30.319497 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:21:30.319497 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:21:30.319497 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:21:30.320523 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:21:30.320523 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:21:30.320523 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:21:30.320523 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:21:30.320523 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:21:30.320523 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:21:30.320523 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:21:30.320523 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6574d506-2cc2-4d16-87d3-eefee1edb1e8 could not be found. Aug 01 14:21:30.320523 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:21:30.320523 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:30.320523 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:21:30.320523 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:30.320523 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:30.320523 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:30.320523 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:21:30.320523 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:21:30.320523 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6574d506-2cc2-4d16-87d3-eefee1edb1e8 could not be found. Aug 01 14:21:30.320523 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:21:30.321441 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-754053ff-be1d-4b46-9d02-01d25778c8c5 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] Returning 404 to user: Instance 6574d506-2cc2-4d16-87d3-eefee1edb1e8 could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:21:30.321441 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-754053ff-be1d-4b46-9d02-01d25778c8c5 tempest-DeleteServersTestJSON-888830500 tempest-DeleteServersTestJSON-888830500-project] 10.222.0.17 "GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8" status: 404 len: 111 microversion: 2.1 time: 0.033984 Aug 01 14:21:30.321441 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 83/162] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:30 2022] GET /compute/v2.1/servers/6574d506-2cc2-4d16-87d3-eefee1edb1e8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:21:41.734542 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:41.735980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=4 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:42.108703 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f2bc735a-15fa-4859-9f90-ceca39624ebd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2133855894", "imageRef": "9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:44.063884 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.network.neutron [None req-f2bc735a-15fa-4859-9f90-ceca39624ebd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] validate_networks() for [('3dcbd2ec-bb6f-4c0c-8d58-c0c56fbad634', None, None, None, None, None)] {{(pid=118132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:21:44.610727 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-f2bc735a-15fa-4859-9f90-ceca39624ebd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Flavor limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:21:44.611143 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-f2bc735a-15fa-4859-9f90-ceca39624ebd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Image limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:21:44.611708 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-f2bc735a-15fa-4859-9f90-ceca39624ebd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Flavor pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:21:44.612728 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-f2bc735a-15fa-4859-9f90-ceca39624ebd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Image pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:21:44.613337 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-f2bc735a-15fa-4859-9f90-ceca39624ebd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:21:44.632106 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f2bc735a-15fa-4859-9f90-ceca39624ebd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:44.632770 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f2bc735a-15fa-4859-9f90-ceca39624ebd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:44.633998 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f2bc735a-15fa-4859-9f90-ceca39624ebd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:44.634578 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f2bc735a-15fa-4859-9f90-ceca39624ebd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:44.681144 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-f2bc735a-15fa-4859-9f90-ceca39624ebd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Getting quotas for project 7b6f2af7de6b4e888e702c78f655448a. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:21:44.692688 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-f2bc735a-15fa-4859-9f90-ceca39624ebd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Getting quotas for user c487e443eb274090bce842e855b015ec and project 7b6f2af7de6b4e888e702c78f655448a. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:21:44.733587 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f2bc735a-15fa-4859-9f90-ceca39624ebd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Going to run 1 instances... {{(pid=118132) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:21:44.736729 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f2bc735a-15fa-4859-9f90-ceca39624ebd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:21:44.835292 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f2bc735a-15fa-4859-9f90-ceca39624ebd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.105767 Aug 01 14:21:44.836147 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 80/163] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Aug 1 14:21:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 3107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:21:44.851182 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-24b3074a-22c1-4059-8ee3-22c228c44bec tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:44.853237 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-24b3074a-22c1-4059-8ee3-22c228c44bec tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:44.863259 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=25 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:44.867211 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=50 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:45.004860 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-24b3074a-22c1-4059-8ee3-22c228c44bec tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:45.020391 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-24b3074a-22c1-4059-8ee3-22c228c44bec tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1222 microversion: 2.1 time: 0.175272 Aug 01 14:21:45.021209 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 84/164] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:44 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1222 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:45.248601 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ac55d1d3-a3d9-48ac-be53-add6fe0036a2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1152147994", "imageRef": "9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:45.349254 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.network.neutron [None req-ac55d1d3-a3d9-48ac-be53-add6fe0036a2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] validate_networks() for [('3dcbd2ec-bb6f-4c0c-8d58-c0c56fbad634', None, None, None, None, None)] {{(pid=118132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:21:46.362085 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-ac55d1d3-a3d9-48ac-be53-add6fe0036a2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Flavor limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:21:46.362694 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-ac55d1d3-a3d9-48ac-be53-add6fe0036a2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Image limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:21:46.366667 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-ac55d1d3-a3d9-48ac-be53-add6fe0036a2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Flavor pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:21:46.368156 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-ac55d1d3-a3d9-48ac-be53-add6fe0036a2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Image pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:21:46.369088 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-ac55d1d3-a3d9-48ac-be53-add6fe0036a2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:21:46.382294 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ac55d1d3-a3d9-48ac-be53-add6fe0036a2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:46.384499 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ac55d1d3-a3d9-48ac-be53-add6fe0036a2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:46.386028 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ac55d1d3-a3d9-48ac-be53-add6fe0036a2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:46.387173 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ac55d1d3-a3d9-48ac-be53-add6fe0036a2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:46.422065 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-ac55d1d3-a3d9-48ac-be53-add6fe0036a2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Getting quotas for project 7b6f2af7de6b4e888e702c78f655448a. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:21:46.426852 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-ac55d1d3-a3d9-48ac-be53-add6fe0036a2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Getting quotas for user c487e443eb274090bce842e855b015ec and project 7b6f2af7de6b4e888e702c78f655448a. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:21:46.439491 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ac55d1d3-a3d9-48ac-be53-add6fe0036a2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Going to run 1 instances... {{(pid=118132) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:21:46.442144 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ac55d1d3-a3d9-48ac-be53-add6fe0036a2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:21:46.501579 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ac55d1d3-a3d9-48ac-be53-add6fe0036a2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.257277 Aug 01 14:21:46.502421 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 81/165] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Aug 1 14:21:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 1259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:21:46.516909 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-16263f29-a76e-42a8-bf49-9f4583c42065 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:46.517520 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-16263f29-a76e-42a8-bf49-9f4583c42065 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:46.687365 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-16263f29-a76e-42a8-bf49-9f4583c42065 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:46.697218 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-16263f29-a76e-42a8-bf49-9f4583c42065 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1222 microversion: 2.1 time: 0.184336 Aug 01 14:21:46.700275 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 85/166] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:46 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1222 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:47.724999 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-263e3a89-5918-4b9e-a8fb-1d4d41bed408 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:47.726240 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-263e3a89-5918-4b9e-a8fb-1d4d41bed408 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:47.736497 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-263e3a89-5918-4b9e-a8fb-1d4d41bed408 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:47.737346 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-263e3a89-5918-4b9e-a8fb-1d4d41bed408 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:47.738557 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-263e3a89-5918-4b9e-a8fb-1d4d41bed408 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:47.739334 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-263e3a89-5918-4b9e-a8fb-1d4d41bed408 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:47.817441 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-263e3a89-5918-4b9e-a8fb-1d4d41bed408 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:47.827408 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-263e3a89-5918-4b9e-a8fb-1d4d41bed408 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1274 microversion: 2.1 time: 0.107507 Aug 01 14:21:47.828119 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 82/167] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:47 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1274 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:48.848699 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ab85b1d3-4901-4b80-9a78-ad0a9b2dc3b8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:48.849880 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ab85b1d3-4901-4b80-9a78-ad0a9b2dc3b8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:48.857375 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ab85b1d3-4901-4b80-9a78-ad0a9b2dc3b8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:48.857976 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ab85b1d3-4901-4b80-9a78-ad0a9b2dc3b8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:48.859007 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ab85b1d3-4901-4b80-9a78-ad0a9b2dc3b8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:48.859623 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ab85b1d3-4901-4b80-9a78-ad0a9b2dc3b8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:48.949081 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ab85b1d3-4901-4b80-9a78-ad0a9b2dc3b8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:48.963560 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ab85b1d3-4901-4b80-9a78-ad0a9b2dc3b8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1280 microversion: 2.1 time: 0.119081 Aug 01 14:21:48.964761 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 86/168] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:48 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1280 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:49.163116 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-2d7af75b-72bd-4b51-b416-5efa19b3534b req-15cdc765-86e2-400c-8c66-698abf9e09ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2775d75f-b4fd-451b-bba5-471868aafc29", "tag": "73f3ff55-6acb-4e37-8c00-8a5a4f09a5d7"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:49.173846 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-2d7af75b-72bd-4b51-b416-5efa19b3534b req-15cdc765-86e2-400c-8c66-698abf9e09ff service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:49.174630 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-2d7af75b-72bd-4b51-b416-5efa19b3534b req-15cdc765-86e2-400c-8c66-698abf9e09ff service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:49.188920 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-2d7af75b-72bd-4b51-b416-5efa19b3534b req-15cdc765-86e2-400c-8c66-698abf9e09ff service nova] Creating event network-changed:73f3ff55-6acb-4e37-8c00-8a5a4f09a5d7 for instance 2775d75f-b4fd-451b-bba5-471868aafc29 on hv-cinder-84599 Aug 01 14:21:49.194429 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-2d7af75b-72bd-4b51-b416-5efa19b3534b req-15cdc765-86e2-400c-8c66-698abf9e09ff service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037014 Aug 01 14:21:49.195306 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 83/169] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:21:49.985486 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7d91bd43-d2bb-4ccf-9e55-84aa5c549b92 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:49.986091 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7d91bd43-d2bb-4ccf-9e55-84aa5c549b92 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:49.994615 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7d91bd43-d2bb-4ccf-9e55-84aa5c549b92 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:49.995063 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7d91bd43-d2bb-4ccf-9e55-84aa5c549b92 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:49.995857 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7d91bd43-d2bb-4ccf-9e55-84aa5c549b92 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:50.004065 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7d91bd43-d2bb-4ccf-9e55-84aa5c549b92 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:50.359043 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7d91bd43-d2bb-4ccf-9e55-84aa5c549b92 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:50.371499 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7d91bd43-d2bb-4ccf-9e55-84aa5c549b92 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1322 microversion: 2.1 time: 0.389460 Aug 01 14:21:50.384194 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 87/170] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:49 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1322 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:51.256870 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-432a2761-579b-4230-9f56-65277a818442 req-852edd5f-4c73-4440-9e2d-2ad0ccd48fdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d", "tag": "e72e4e9c-0136-4f4f-a7e1-0f7843f8ac00"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:51.284333 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-432a2761-579b-4230-9f56-65277a818442 req-852edd5f-4c73-4440-9e2d-2ad0ccd48fdf service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:51.285299 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-432a2761-579b-4230-9f56-65277a818442 req-852edd5f-4c73-4440-9e2d-2ad0ccd48fdf service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:51.297790 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-432a2761-579b-4230-9f56-65277a818442 req-852edd5f-4c73-4440-9e2d-2ad0ccd48fdf service nova] Creating event network-changed:e72e4e9c-0136-4f4f-a7e1-0f7843f8ac00 for instance 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d on hv-cinder-84599 Aug 01 14:21:51.313157 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-432a2761-579b-4230-9f56-65277a818442 req-852edd5f-4c73-4440-9e2d-2ad0ccd48fdf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087412 Aug 01 14:21:51.313157 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 84/171] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:21:51.393519 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-31e50a2b-4f0e-4e9f-895c-21542c985054 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:51.394585 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-31e50a2b-4f0e-4e9f-895c-21542c985054 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:51.403842 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-31e50a2b-4f0e-4e9f-895c-21542c985054 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:51.404792 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-31e50a2b-4f0e-4e9f-895c-21542c985054 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:51.406551 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-31e50a2b-4f0e-4e9f-895c-21542c985054 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:51.406694 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-31e50a2b-4f0e-4e9f-895c-21542c985054 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:51.820435 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-31e50a2b-4f0e-4e9f-895c-21542c985054 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:51.832139 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-31e50a2b-4f0e-4e9f-895c-21542c985054 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1322 microversion: 2.1 time: 0.442773 Aug 01 14:21:51.844766 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 88/172] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:51 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1322 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:52.856889 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1adc7fee-d035-43b0-90f0-4dfde218802b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:52.857646 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-1adc7fee-d035-43b0-90f0-4dfde218802b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:52.864347 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1adc7fee-d035-43b0-90f0-4dfde218802b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:52.864899 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1adc7fee-d035-43b0-90f0-4dfde218802b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:52.865766 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1adc7fee-d035-43b0-90f0-4dfde218802b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:52.866284 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1adc7fee-d035-43b0-90f0-4dfde218802b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:53.028849 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1adc7fee-d035-43b0-90f0-4dfde218802b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:53.036793 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-1adc7fee-d035-43b0-90f0-4dfde218802b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1322 microversion: 2.1 time: 0.184772 Aug 01 14:21:53.037464 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 85/173] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:52 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:54.059921 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6256819f-05e2-4a73-b3d5-b8ff9318b5fa tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:54.061797 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-6256819f-05e2-4a73-b3d5-b8ff9318b5fa tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:54.070492 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6256819f-05e2-4a73-b3d5-b8ff9318b5fa tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:54.071590 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6256819f-05e2-4a73-b3d5-b8ff9318b5fa tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:54.072629 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6256819f-05e2-4a73-b3d5-b8ff9318b5fa tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:54.073287 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6256819f-05e2-4a73-b3d5-b8ff9318b5fa tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:54.266956 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6256819f-05e2-4a73-b3d5-b8ff9318b5fa tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:54.275518 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6256819f-05e2-4a73-b3d5-b8ff9318b5fa tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1322 microversion: 2.1 time: 0.220214 Aug 01 14:21:54.276115 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 89/174] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:54 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:55.306034 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-38bec16b-2960-4912-a728-cc8fd9915602 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:55.306732 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-38bec16b-2960-4912-a728-cc8fd9915602 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:55.322829 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-38bec16b-2960-4912-a728-cc8fd9915602 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:55.323297 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-38bec16b-2960-4912-a728-cc8fd9915602 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:55.328102 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-38bec16b-2960-4912-a728-cc8fd9915602 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:55.328671 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-38bec16b-2960-4912-a728-cc8fd9915602 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:55.563040 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-77c9c7ea-bdb6-4f28-a0f8-28f3fb31ef0b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ae8521a-03cd-49b4-b26d-3c8861fedd63", "device": "/dev/sdb"}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:55.566487 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-38bec16b-2960-4912-a728-cc8fd9915602 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:55.567531 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-77c9c7ea-bdb6-4f28-a0f8-28f3fb31ef0b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:55.574402 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-77c9c7ea-bdb6-4f28-a0f8-28f3fb31ef0b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:55.574851 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-77c9c7ea-bdb6-4f28-a0f8-28f3fb31ef0b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:55.575657 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-77c9c7ea-bdb6-4f28-a0f8-28f3fb31ef0b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:55.575796 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-38bec16b-2960-4912-a728-cc8fd9915602 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1322 microversion: 2.1 time: 0.274462 Aug 01 14:21:55.576090 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-77c9c7ea-bdb6-4f28-a0f8-28f3fb31ef0b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:55.576577 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 86/175] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:55 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:55.938745 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-77c9c7ea-bdb6-4f28-a0f8-28f3fb31ef0b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "POST /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.380250 Aug 01 14:21:55.939599 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 90/176] 10.222.0.17 () {60 vars in 1323 bytes} [Mon Aug 1 14:21:55 2022] POST /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4/os-volume_attachments => generated 194 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:21:56.392956 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-b983dd1f-3255-4cb6-967c-cbd08f764480 req-c5df7b0b-d015-42ed-b607-963fb1e6f78b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2775d75f-b4fd-451b-bba5-471868aafc29", "name": "network-vif-plugged", "status": "completed", "tag": "73f3ff55-6acb-4e37-8c00-8a5a4f09a5d7"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:56.423672 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=4 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:56.428800 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-b983dd1f-3255-4cb6-967c-cbd08f764480 req-c5df7b0b-d015-42ed-b607-963fb1e6f78b service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:56.429562 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-b983dd1f-3255-4cb6-967c-cbd08f764480 req-c5df7b0b-d015-42ed-b607-963fb1e6f78b service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:56.441398 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=12 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:56.444304 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-b983dd1f-3255-4cb6-967c-cbd08f764480 req-c5df7b0b-d015-42ed-b607-963fb1e6f78b service nova] Creating event network-vif-plugged:73f3ff55-6acb-4e37-8c00-8a5a4f09a5d7 for instance 2775d75f-b4fd-451b-bba5-471868aafc29 on hv-cinder-84599 Aug 01 14:21:56.450159 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-b983dd1f-3255-4cb6-967c-cbd08f764480 req-c5df7b0b-d015-42ed-b607-963fb1e6f78b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061993 Aug 01 14:21:56.451791 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 87/177] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:21:56.602809 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-1585e181-5153-4683-b988-e1d253156f29 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:56.603664 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1585e181-5153-4683-b988-e1d253156f29 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:56.612514 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1585e181-5153-4683-b988-e1d253156f29 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:56.612978 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1585e181-5153-4683-b988-e1d253156f29 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:56.613943 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1585e181-5153-4683-b988-e1d253156f29 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:56.614378 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1585e181-5153-4683-b988-e1d253156f29 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:56.692867 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=4 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:56.775144 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1585e181-5153-4683-b988-e1d253156f29 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:56.783127 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-1585e181-5153-4683-b988-e1d253156f29 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1322 microversion: 2.1 time: 0.185334 Aug 01 14:21:56.784306 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 91/178] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:56 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:57.810334 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-701322ae-7b3a-46ba-93a7-5b335e635a8f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:57.812408 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-701322ae-7b3a-46ba-93a7-5b335e635a8f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:57.824788 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-701322ae-7b3a-46ba-93a7-5b335e635a8f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:57.825736 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-701322ae-7b3a-46ba-93a7-5b335e635a8f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:57.827057 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-701322ae-7b3a-46ba-93a7-5b335e635a8f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:57.827744 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-701322ae-7b3a-46ba-93a7-5b335e635a8f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:58.049619 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-701322ae-7b3a-46ba-93a7-5b335e635a8f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:58.058953 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-701322ae-7b3a-46ba-93a7-5b335e635a8f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1322 microversion: 2.1 time: 0.256154 Aug 01 14:21:58.058953 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 88/179] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:57 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:59.081814 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-1d7912df-a674-43bd-88ea-32a69ba0aa47 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:59.082545 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1d7912df-a674-43bd-88ea-32a69ba0aa47 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:59.089279 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1d7912df-a674-43bd-88ea-32a69ba0aa47 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:59.089721 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1d7912df-a674-43bd-88ea-32a69ba0aa47 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:59.091428 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1d7912df-a674-43bd-88ea-32a69ba0aa47 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:59.092152 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1d7912df-a674-43bd-88ea-32a69ba0aa47 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:59.334529 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1d7912df-a674-43bd-88ea-32a69ba0aa47 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:59.346712 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-1d7912df-a674-43bd-88ea-32a69ba0aa47 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1322 microversion: 2.1 time: 0.269505 Aug 01 14:21:59.347301 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 92/180] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:59 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:59.561655 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6b8e130c-d407-4a0c-9126-a14ba8965ef9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:59.562236 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-6b8e130c-d407-4a0c-9126-a14ba8965ef9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:59.569313 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6b8e130c-d407-4a0c-9126-a14ba8965ef9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:59.569760 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6b8e130c-d407-4a0c-9126-a14ba8965ef9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:59.570529 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6b8e130c-d407-4a0c-9126-a14ba8965ef9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:59.570959 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6b8e130c-d407-4a0c-9126-a14ba8965ef9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:59.596124 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6b8e130c-d407-4a0c-9126-a14ba8965ef9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711/ips" status: 200 len: 150 microversion: 2.1 time: 0.038232 Aug 01 14:21:59.597278 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 89/181] 10.222.0.17 () {58 vars in 1248 bytes} [Mon Aug 1 14:21:59 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:22:00.368599 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-1805373f-3f5c-4117-be47-4e3fbb727448 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:00.369886 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1805373f-3f5c-4117-be47-4e3fbb727448 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:00.377646 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1805373f-3f5c-4117-be47-4e3fbb727448 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:00.378112 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1805373f-3f5c-4117-be47-4e3fbb727448 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:00.379064 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1805373f-3f5c-4117-be47-4e3fbb727448 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:00.379408 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1805373f-3f5c-4117-be47-4e3fbb727448 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:00.515378 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1805373f-3f5c-4117-be47-4e3fbb727448 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:00.524483 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-1805373f-3f5c-4117-be47-4e3fbb727448 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1322 microversion: 2.1 time: 0.159951 Aug 01 14:22:00.525071 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 93/182] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:00 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:00.600720 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-dceb5baf-86f2-4cec-af29-ebb1f7f5fc04 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:00.601324 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-dceb5baf-86f2-4cec-af29-ebb1f7f5fc04 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:00.607794 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dceb5baf-86f2-4cec-af29-ebb1f7f5fc04 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:00.608243 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dceb5baf-86f2-4cec-af29-ebb1f7f5fc04 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:00.609011 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dceb5baf-86f2-4cec-af29-ebb1f7f5fc04 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:00.609438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dceb5baf-86f2-4cec-af29-ebb1f7f5fc04 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:00.634320 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-dceb5baf-86f2-4cec-af29-ebb1f7f5fc04 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680/ips" status: 200 len: 152 microversion: 2.20 time: 0.038227 Aug 01 14:22:00.634910 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 90/183] 10.222.0.17 () {60 vars in 1289 bytes} [Mon Aug 1 14:22:00 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 14:22:01.552620 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-4a5a3cc4-d938-4cce-b595-aad9749077eb tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:01.553277 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-4a5a3cc4-d938-4cce-b595-aad9749077eb tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:01.559772 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4a5a3cc4-d938-4cce-b595-aad9749077eb tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:01.560219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4a5a3cc4-d938-4cce-b595-aad9749077eb tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:01.560983 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4a5a3cc4-d938-4cce-b595-aad9749077eb tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:01.561414 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4a5a3cc4-d938-4cce-b595-aad9749077eb tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:01.696415 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4a5a3cc4-d938-4cce-b595-aad9749077eb tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:01.705089 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-4a5a3cc4-d938-4cce-b595-aad9749077eb tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1322 microversion: 2.1 time: 0.156142 Aug 01 14:22:01.706349 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 94/184] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:01 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:02.726770 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7ce6a88b-b069-4954-b975-7f3407bf55ce tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:02.727378 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7ce6a88b-b069-4954-b975-7f3407bf55ce tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:02.734114 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7ce6a88b-b069-4954-b975-7f3407bf55ce tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:02.734637 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7ce6a88b-b069-4954-b975-7f3407bf55ce tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:02.735352 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7ce6a88b-b069-4954-b975-7f3407bf55ce tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:02.735812 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7ce6a88b-b069-4954-b975-7f3407bf55ce tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:02.904134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7ce6a88b-b069-4954-b975-7f3407bf55ce tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:02.915094 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7ce6a88b-b069-4954-b975-7f3407bf55ce tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1322 microversion: 2.1 time: 0.192200 Aug 01 14:22:02.916310 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 91/185] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:02 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:03.009879 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-7cb19194-5f76-46c4-b07d-258725415a01 req-c8a10a82-c7ce-4cde-b605-e7449fca6a56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d", "name": "network-vif-plugged", "status": "completed", "tag": "e72e4e9c-0136-4f4f-a7e1-0f7843f8ac00"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:03.024877 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-7cb19194-5f76-46c4-b07d-258725415a01 req-c8a10a82-c7ce-4cde-b605-e7449fca6a56 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:03.025501 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-7cb19194-5f76-46c4-b07d-258725415a01 req-c8a10a82-c7ce-4cde-b605-e7449fca6a56 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:03.040368 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-7cb19194-5f76-46c4-b07d-258725415a01 req-c8a10a82-c7ce-4cde-b605-e7449fca6a56 service nova] Creating event network-vif-plugged:e72e4e9c-0136-4f4f-a7e1-0f7843f8ac00 for instance 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d on hv-cinder-84599 Aug 01 14:22:03.048886 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-7cb19194-5f76-46c4-b07d-258725415a01 req-c8a10a82-c7ce-4cde-b605-e7449fca6a56 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042716 Aug 01 14:22:03.049493 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 95/186] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:22:03.215686 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e7c91e03-e6ae-4749-bc57-08762e70cc57 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e24bf2e8-2a04-4666-9df8-96cbc917b91f"}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:03.218441 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e7c91e03-e6ae-4749-bc57-08762e70cc57 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:03.225828 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e7c91e03-e6ae-4749-bc57-08762e70cc57 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:03.226281 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e7c91e03-e6ae-4749-bc57-08762e70cc57 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:03.227141 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e7c91e03-e6ae-4749-bc57-08762e70cc57 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:03.227594 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e7c91e03-e6ae-4749-bc57-08762e70cc57 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:03.767821 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f0b356a2-b0c7-4d01-b61d-82dfbc05e02e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1344123872", "imageRef": "9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1", "flavorRef": "452", "networks": [{"uuid": "008507c5-1925-4e7a-8867-5e7af7f7fd82"}]}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:03.822591 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.network.neutron [None req-f0b356a2-b0c7-4d01-b61d-82dfbc05e02e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] validate_networks() for [('008507c5-1925-4e7a-8867-5e7af7f7fd82', None, None, None, None, None)] {{(pid=118133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:22:04.195752 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-f0b356a2-b0c7-4d01-b61d-82dfbc05e02e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Flavor limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:22:04.196361 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-f0b356a2-b0c7-4d01-b61d-82dfbc05e02e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Image limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:22:04.196619 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-f0b356a2-b0c7-4d01-b61d-82dfbc05e02e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Flavor pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:22:04.197014 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-f0b356a2-b0c7-4d01-b61d-82dfbc05e02e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Image pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:22:04.197415 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-f0b356a2-b0c7-4d01-b61d-82dfbc05e02e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:22:04.207849 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f0b356a2-b0c7-4d01-b61d-82dfbc05e02e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:04.208397 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f0b356a2-b0c7-4d01-b61d-82dfbc05e02e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:04.209270 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f0b356a2-b0c7-4d01-b61d-82dfbc05e02e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:04.209778 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f0b356a2-b0c7-4d01-b61d-82dfbc05e02e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:04.228195 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-f0b356a2-b0c7-4d01-b61d-82dfbc05e02e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Getting quotas for project d6dd5eef6c62467ab15a23233e366185. Resources: {'instances', 'cores', 'ram'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:22:04.233125 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-f0b356a2-b0c7-4d01-b61d-82dfbc05e02e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Getting quotas for user bbbdf80e14b647cbbdb3d292d534d987 and project d6dd5eef6c62467ab15a23233e366185. Resources: {'instances', 'cores', 'ram'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:22:04.244710 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f0b356a2-b0c7-4d01-b61d-82dfbc05e02e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Going to run 1 instances... {{(pid=118133) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:22:04.247089 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f0b356a2-b0c7-4d01-b61d-82dfbc05e02e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:22:04.301637 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f0b356a2-b0c7-4d01-b61d-82dfbc05e02e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534267 Aug 01 14:22:04.301637 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 96/187] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Aug 1 14:22:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 14:22:04.303807 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-72375e85-a65a-40b1-90c7-1de94ded842c tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:04.304472 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-72375e85-a65a-40b1-90c7-1de94ded842c tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:04.314945 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-72375e85-a65a-40b1-90c7-1de94ded842c tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:04.315736 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-72375e85-a65a-40b1-90c7-1de94ded842c tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:04.316519 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-72375e85-a65a-40b1-90c7-1de94ded842c tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:04.316951 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-72375e85-a65a-40b1-90c7-1de94ded842c tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:04.499039 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-72375e85-a65a-40b1-90c7-1de94ded842c tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:04.518271 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-72375e85-a65a-40b1-90c7-1de94ded842c tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1322 microversion: 2.1 time: 0.217470 Aug 01 14:22:04.518883 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 97/188] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:04 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:04.528741 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-01e4e543-4d8a-4b46-8994-d35733354b16 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:04.538549 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-01e4e543-4d8a-4b46-8994-d35733354b16 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:04.598170 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-01e4e543-4d8a-4b46-8994-d35733354b16 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:04.607283 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-01e4e543-4d8a-4b46-8994-d35733354b16 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1214 microversion: 2.1 time: 0.085834 Aug 01 14:22:04.607948 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 98/189] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:04 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:04.736994 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-15e5a58f-223c-4eca-baf6-9aae1574b570 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:04.737638 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-15e5a58f-223c-4eca-baf6-9aae1574b570 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:04.743869 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-15e5a58f-223c-4eca-baf6-9aae1574b570 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:04.744424 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-15e5a58f-223c-4eca-baf6-9aae1574b570 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:04.745207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-15e5a58f-223c-4eca-baf6-9aae1574b570 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:04.745635 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-15e5a58f-223c-4eca-baf6-9aae1574b570 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:04.771533 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-15e5a58f-223c-4eca-baf6-9aae1574b570 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lazy-loading 'flavor' on Instance uuid 76deb7da-88aa-4c26-b55d-fd6432d1e680 {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:22:05.022452 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-15e5a58f-223c-4eca-baf6-9aae1574b570 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "POST /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680/action" status: 202 len: 0 microversion: 2.20 time: 0.289444 Aug 01 14:22:05.023056 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 99/190] 10.222.0.17 () {62 vars in 1319 bytes} [Mon Aug 1 14:22:04 2022] POST /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 01 14:22:05.032625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7cb1e888-9708-4243-b9e4-e395370343af tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:05.033869 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7cb1e888-9708-4243-b9e4-e395370343af tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:05.040598 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7cb1e888-9708-4243-b9e4-e395370343af tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:05.041036 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7cb1e888-9708-4243-b9e4-e395370343af tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:05.041801 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7cb1e888-9708-4243-b9e4-e395370343af tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:05.042239 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7cb1e888-9708-4243-b9e4-e395370343af tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:05.181610 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7cb1e888-9708-4243-b9e4-e395370343af tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:05.190041 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7cb1e888-9708-4243-b9e4-e395370343af tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:05.191564 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7cb1e888-9708-4243-b9e4-e395370343af tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:05.192749 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7cb1e888-9708-4243-b9e4-e395370343af tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1724 microversion: 2.20 time: 0.164573 Aug 01 14:22:05.193322 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 100/191] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:05 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:22:05.538601 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0aa43c14-0e6b-4aaa-9185-d67eddab8bd1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:05.539297 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0aa43c14-0e6b-4aaa-9185-d67eddab8bd1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:05.546985 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0aa43c14-0e6b-4aaa-9185-d67eddab8bd1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:05.547435 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0aa43c14-0e6b-4aaa-9185-d67eddab8bd1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:05.548445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0aa43c14-0e6b-4aaa-9185-d67eddab8bd1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:05.548879 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0aa43c14-0e6b-4aaa-9185-d67eddab8bd1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:05.568514 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:05.683518 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0aa43c14-0e6b-4aaa-9185-d67eddab8bd1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:05.691845 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0aa43c14-0e6b-4aaa-9185-d67eddab8bd1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1322 microversion: 2.1 time: 0.157493 Aug 01 14:22:05.692720 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 101/192] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:05 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:05.697394 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7255d4b4-9b4d-4cef-aada-c21b1d7c5e58 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:05.697996 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7255d4b4-9b4d-4cef-aada-c21b1d7c5e58 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:05.706734 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7255d4b4-9b4d-4cef-aada-c21b1d7c5e58 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:05.707177 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7255d4b4-9b4d-4cef-aada-c21b1d7c5e58 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:05.707981 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7255d4b4-9b4d-4cef-aada-c21b1d7c5e58 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:05.708417 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7255d4b4-9b4d-4cef-aada-c21b1d7c5e58 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:05.771122 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7255d4b4-9b4d-4cef-aada-c21b1d7c5e58 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:05.780022 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7255d4b4-9b4d-4cef-aada-c21b1d7c5e58 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1218 microversion: 2.1 time: 0.086144 Aug 01 14:22:05.780625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 102/193] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:05 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:06.216454 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-475de2c3-7c05-4af8-adf6-c758647fe592 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:06.217053 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-475de2c3-7c05-4af8-adf6-c758647fe592 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:06.224606 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-475de2c3-7c05-4af8-adf6-c758647fe592 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:06.225057 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-475de2c3-7c05-4af8-adf6-c758647fe592 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:06.225865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-475de2c3-7c05-4af8-adf6-c758647fe592 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:06.226438 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-475de2c3-7c05-4af8-adf6-c758647fe592 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:06.363087 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-475de2c3-7c05-4af8-adf6-c758647fe592 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:06.370983 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-475de2c3-7c05-4af8-adf6-c758647fe592 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:06.372493 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-475de2c3-7c05-4af8-adf6-c758647fe592 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:06.373632 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-475de2c3-7c05-4af8-adf6-c758647fe592 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1724 microversion: 2.20 time: 0.161165 Aug 01 14:22:06.374188 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 103/194] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:06 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:22:06.712812 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7c0e281e-14fe-4c18-8046-ff013e8409f3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:06.713427 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7c0e281e-14fe-4c18-8046-ff013e8409f3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:06.719545 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7c0e281e-14fe-4c18-8046-ff013e8409f3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:06.719996 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7c0e281e-14fe-4c18-8046-ff013e8409f3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:06.721672 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7c0e281e-14fe-4c18-8046-ff013e8409f3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:06.722110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7c0e281e-14fe-4c18-8046-ff013e8409f3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:06.888341 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7c0e281e-14fe-4c18-8046-ff013e8409f3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:06.898173 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7c0e281e-14fe-4c18-8046-ff013e8409f3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1322 microversion: 2.1 time: 0.189100 Aug 01 14:22:06.899313 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 104/195] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:06 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:06.904550 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a37ad02c-4548-4dcf-8a5f-473130c775c5 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:06.905390 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a37ad02c-4548-4dcf-8a5f-473130c775c5 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:06.912241 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a37ad02c-4548-4dcf-8a5f-473130c775c5 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:06.913031 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a37ad02c-4548-4dcf-8a5f-473130c775c5 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:06.913993 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a37ad02c-4548-4dcf-8a5f-473130c775c5 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:06.914421 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a37ad02c-4548-4dcf-8a5f-473130c775c5 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:06.984115 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a37ad02c-4548-4dcf-8a5f-473130c775c5 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:06.992109 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a37ad02c-4548-4dcf-8a5f-473130c775c5 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1218 microversion: 2.1 time: 0.091560 Aug 01 14:22:06.992678 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 105/196] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:06 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:07.196241 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e7c91e03-e6ae-4749-bc57-08762e70cc57 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "POST /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.984701 Aug 01 14:22:07.197222 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 92/197] 10.222.0.17 () {60 vars in 1323 bytes} [Mon Aug 1 14:22:03 2022] POST /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711/os-volume_attachments => generated 194 bytes in 3987 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:22:07.396186 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-cd809961-bc9c-44f2-ae73-d338fddad55f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:07.396775 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-cd809961-bc9c-44f2-ae73-d338fddad55f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:07.403381 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cd809961-bc9c-44f2-ae73-d338fddad55f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:07.403843 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cd809961-bc9c-44f2-ae73-d338fddad55f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:07.404590 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cd809961-bc9c-44f2-ae73-d338fddad55f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:07.405016 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cd809961-bc9c-44f2-ae73-d338fddad55f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:07.548604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-cd809961-bc9c-44f2-ae73-d338fddad55f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:07.557235 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-cd809961-bc9c-44f2-ae73-d338fddad55f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:07.559008 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-cd809961-bc9c-44f2-ae73-d338fddad55f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:07.560020 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-cd809961-bc9c-44f2-ae73-d338fddad55f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1724 microversion: 2.20 time: 0.168277 Aug 01 14:22:07.561336 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 106/198] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:07 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:22:07.922432 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-33a60d99-8a96-4e31-9b4b-73ac65068fab tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:07.923051 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-33a60d99-8a96-4e31-9b4b-73ac65068fab tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:07.930709 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-33a60d99-8a96-4e31-9b4b-73ac65068fab tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:07.931138 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-33a60d99-8a96-4e31-9b4b-73ac65068fab tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:07.931948 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-33a60d99-8a96-4e31-9b4b-73ac65068fab tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:07.932377 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-33a60d99-8a96-4e31-9b4b-73ac65068fab tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:08.013184 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3ec17585-c78e-404d-ad9d-e5579ec19e05 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:08.014018 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3ec17585-c78e-404d-ad9d-e5579ec19e05 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:08.020694 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3ec17585-c78e-404d-ad9d-e5579ec19e05 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:08.021217 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3ec17585-c78e-404d-ad9d-e5579ec19e05 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:08.022071 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3ec17585-c78e-404d-ad9d-e5579ec19e05 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:08.022576 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3ec17585-c78e-404d-ad9d-e5579ec19e05 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:08.077431 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-33a60d99-8a96-4e31-9b4b-73ac65068fab tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:08.085605 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-33a60d99-8a96-4e31-9b4b-73ac65068fab tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1322 microversion: 2.1 time: 0.167970 Aug 01 14:22:08.086336 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 93/199] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:07 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:08.097114 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3ec17585-c78e-404d-ad9d-e5579ec19e05 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:08.104643 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3ec17585-c78e-404d-ad9d-e5579ec19e05 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1266 microversion: 2.1 time: 0.095286 Aug 01 14:22:08.105251 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 107/200] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:08 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:08.583790 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f0a7ef71-2d7d-4dab-b750-f3ab599b568e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:08.584356 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f0a7ef71-2d7d-4dab-b750-f3ab599b568e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:08.591000 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f0a7ef71-2d7d-4dab-b750-f3ab599b568e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:08.591441 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f0a7ef71-2d7d-4dab-b750-f3ab599b568e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:08.592225 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f0a7ef71-2d7d-4dab-b750-f3ab599b568e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:08.592677 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f0a7ef71-2d7d-4dab-b750-f3ab599b568e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:08.734945 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f0a7ef71-2d7d-4dab-b750-f3ab599b568e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:08.743763 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f0a7ef71-2d7d-4dab-b750-f3ab599b568e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:08.745734 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f0a7ef71-2d7d-4dab-b750-f3ab599b568e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:08.747426 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f0a7ef71-2d7d-4dab-b750-f3ab599b568e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1724 microversion: 2.20 time: 0.167871 Aug 01 14:22:08.748371 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 94/201] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:08 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:09.106301 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-1ebb678a-5d22-44d1-b258-1a56f98c0015 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:09.106867 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1ebb678a-5d22-44d1-b258-1a56f98c0015 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:09.125547 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b8e7911a-a002-45a2-a269-5c20ed7f790c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:09.126277 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b8e7911a-a002-45a2-a269-5c20ed7f790c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:09.131711 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1ebb678a-5d22-44d1-b258-1a56f98c0015 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:09.132171 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1ebb678a-5d22-44d1-b258-1a56f98c0015 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:09.133063 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1ebb678a-5d22-44d1-b258-1a56f98c0015 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:09.133508 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1ebb678a-5d22-44d1-b258-1a56f98c0015 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:09.134648 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b8e7911a-a002-45a2-a269-5c20ed7f790c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:09.135328 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b8e7911a-a002-45a2-a269-5c20ed7f790c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:09.136565 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b8e7911a-a002-45a2-a269-5c20ed7f790c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:09.137208 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b8e7911a-a002-45a2-a269-5c20ed7f790c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:09.216783 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b8e7911a-a002-45a2-a269-5c20ed7f790c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:09.227795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b8e7911a-a002-45a2-a269-5c20ed7f790c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1284 microversion: 2.1 time: 0.105565 Aug 01 14:22:09.229353 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 95/202] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:09 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:09.312601 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1ebb678a-5d22-44d1-b258-1a56f98c0015 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:09.320644 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-1ebb678a-5d22-44d1-b258-1a56f98c0015 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1516 microversion: 2.1 time: 0.218370 Aug 01 14:22:09.321225 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 108/203] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:09 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1516 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:09.341679 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ddf00a91-ec9b-4faf-8975-5caee5d27de7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:09.344026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ddf00a91-ec9b-4faf-8975-5caee5d27de7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:09.350569 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ddf00a91-ec9b-4faf-8975-5caee5d27de7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:09.351166 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ddf00a91-ec9b-4faf-8975-5caee5d27de7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:09.352003 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ddf00a91-ec9b-4faf-8975-5caee5d27de7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:09.352551 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ddf00a91-ec9b-4faf-8975-5caee5d27de7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:09.380988 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-ddf00a91-ec9b-4faf-8975-5caee5d27de7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lazy-loading 'flavor' on Instance uuid 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:22:09.489728 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ddf00a91-ec9b-4faf-8975-5caee5d27de7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "POST /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d/action" status: 200 len: 32 microversion: 2.1 time: 0.151796 Aug 01 14:22:09.490220 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 96/204] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Aug 1 14:22:09 2022] POST /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d/action => generated 32 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:22:09.499938 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e86c157e-d19b-4207-8d89-9967c51c49e0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:09.500528 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e86c157e-d19b-4207-8d89-9967c51c49e0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:09.507712 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e86c157e-d19b-4207-8d89-9967c51c49e0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:09.507948 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e86c157e-d19b-4207-8d89-9967c51c49e0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:09.508687 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e86c157e-d19b-4207-8d89-9967c51c49e0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:09.509121 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e86c157e-d19b-4207-8d89-9967c51c49e0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:09.677800 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e86c157e-d19b-4207-8d89-9967c51c49e0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:09.685563 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e86c157e-d19b-4207-8d89-9967c51c49e0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.189525 Aug 01 14:22:09.686144 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 109/205] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:09 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:09.772230 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1ada4961-512d-4be6-86c3-b83db101db95 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:09.773071 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-1ada4961-512d-4be6-86c3-b83db101db95 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:09.780390 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1ada4961-512d-4be6-86c3-b83db101db95 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:09.782538 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1ada4961-512d-4be6-86c3-b83db101db95 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:09.784022 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1ada4961-512d-4be6-86c3-b83db101db95 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:09.784416 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1ada4961-512d-4be6-86c3-b83db101db95 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:09.789546 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:09.949509 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1ada4961-512d-4be6-86c3-b83db101db95 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:09.960761 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1ada4961-512d-4be6-86c3-b83db101db95 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:09.962263 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1ada4961-512d-4be6-86c3-b83db101db95 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:09.973054 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-1ada4961-512d-4be6-86c3-b83db101db95 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1724 microversion: 2.20 time: 0.205116 Aug 01 14:22:09.973952 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 97/206] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:09 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:22:10.250262 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-cae5b6d2-f0c4-4781-bb9e-714fafe021c9 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:10.250983 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-cae5b6d2-f0c4-4781-bb9e-714fafe021c9 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:10.260340 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cae5b6d2-f0c4-4781-bb9e-714fafe021c9 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:10.260691 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cae5b6d2-f0c4-4781-bb9e-714fafe021c9 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:10.261553 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cae5b6d2-f0c4-4781-bb9e-714fafe021c9 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:10.262827 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cae5b6d2-f0c4-4781-bb9e-714fafe021c9 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:10.396235 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-cae5b6d2-f0c4-4781-bb9e-714fafe021c9 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:10.408542 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-cae5b6d2-f0c4-4781-bb9e-714fafe021c9 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1272 microversion: 2.1 time: 0.162115 Aug 01 14:22:10.409497 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 110/207] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:10 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1272 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:10.707252 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6667b2f6-4c8e-4170-9820-44b61aecbb5b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:10.707973 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-6667b2f6-4c8e-4170-9820-44b61aecbb5b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:10.716710 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6667b2f6-4c8e-4170-9820-44b61aecbb5b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:10.717287 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6667b2f6-4c8e-4170-9820-44b61aecbb5b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:10.718146 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6667b2f6-4c8e-4170-9820-44b61aecbb5b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:10.718827 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6667b2f6-4c8e-4170-9820-44b61aecbb5b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:10.881098 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6667b2f6-4c8e-4170-9820-44b61aecbb5b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:10.890322 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6667b2f6-4c8e-4170-9820-44b61aecbb5b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.187518 Aug 01 14:22:10.890910 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 98/208] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:10 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:10.996581 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-76e847c9-1912-4c74-bfd5-241b7444da0e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:10.997186 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-76e847c9-1912-4c74-bfd5-241b7444da0e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:11.003427 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-76e847c9-1912-4c74-bfd5-241b7444da0e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:11.003905 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-76e847c9-1912-4c74-bfd5-241b7444da0e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:11.004682 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-76e847c9-1912-4c74-bfd5-241b7444da0e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:11.005131 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-76e847c9-1912-4c74-bfd5-241b7444da0e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:11.440688 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c7b4c80d-0959-45c4-a121-a773ba984279 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:11.441662 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c7b4c80d-0959-45c4-a121-a773ba984279 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:11.464120 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c7b4c80d-0959-45c4-a121-a773ba984279 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:11.466747 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c7b4c80d-0959-45c4-a121-a773ba984279 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:11.467703 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c7b4c80d-0959-45c4-a121-a773ba984279 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:11.468700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c7b4c80d-0959-45c4-a121-a773ba984279 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:11.551583 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-76e847c9-1912-4c74-bfd5-241b7444da0e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:11.580857 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-76e847c9-1912-4c74-bfd5-241b7444da0e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:11.584308 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-76e847c9-1912-4c74-bfd5-241b7444da0e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:11.585591 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-76e847c9-1912-4c74-bfd5-241b7444da0e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1724 microversion: 2.20 time: 0.593131 Aug 01 14:22:11.587154 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 111/209] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:10 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1724 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:22:11.711965 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c7b4c80d-0959-45c4-a121-a773ba984279 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:11.722122 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c7b4c80d-0959-45c4-a121-a773ba984279 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1314 microversion: 2.1 time: 0.292964 Aug 01 14:22:11.723798 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 99/210] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:11 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:11.915252 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d0f03041-1987-4155-8a61-376aa9985021 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:11.915910 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d0f03041-1987-4155-8a61-376aa9985021 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:11.922901 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d0f03041-1987-4155-8a61-376aa9985021 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:11.923075 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d0f03041-1987-4155-8a61-376aa9985021 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:11.924414 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d0f03041-1987-4155-8a61-376aa9985021 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:11.925027 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d0f03041-1987-4155-8a61-376aa9985021 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:12.136222 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d0f03041-1987-4155-8a61-376aa9985021 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:12.144945 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d0f03041-1987-4155-8a61-376aa9985021 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.237021 Aug 01 14:22:12.145718 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 112/211] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:11 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:12.186054 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-de5a9718-e42a-439b-932c-cb8b7f4be70e req-4d81308e-ddb8-45e0-a670-1a4dad0026d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15f45ea0-8c33-457c-88d7-e027e4a9109e", "tag": "726cf288-ee4a-4a3b-8fd7-a4a8bcff4423"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:12.190888 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=6 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:12.197038 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-de5a9718-e42a-439b-932c-cb8b7f4be70e req-4d81308e-ddb8-45e0-a670-1a4dad0026d0 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:12.197483 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-de5a9718-e42a-439b-932c-cb8b7f4be70e req-4d81308e-ddb8-45e0-a670-1a4dad0026d0 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:12.210506 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-de5a9718-e42a-439b-932c-cb8b7f4be70e req-4d81308e-ddb8-45e0-a670-1a4dad0026d0 service nova] Creating event network-changed:726cf288-ee4a-4a3b-8fd7-a4a8bcff4423 for instance 15f45ea0-8c33-457c-88d7-e027e4a9109e on hv-cinder-84599 Aug 01 14:22:12.223139 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-de5a9718-e42a-439b-932c-cb8b7f4be70e req-4d81308e-ddb8-45e0-a670-1a4dad0026d0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040752 Aug 01 14:22:12.223794 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 100/212] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:22:12.612145 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7a893d04-65f3-486e-b862-5b08d1971391 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:12.612750 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7a893d04-65f3-486e-b862-5b08d1971391 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:12.619483 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7a893d04-65f3-486e-b862-5b08d1971391 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:12.619925 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7a893d04-65f3-486e-b862-5b08d1971391 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:12.620846 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7a893d04-65f3-486e-b862-5b08d1971391 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:12.621108 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7a893d04-65f3-486e-b862-5b08d1971391 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:12.758776 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-39939868-19fd-484b-a966-413235d84d39 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:12.759377 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7a893d04-65f3-486e-b862-5b08d1971391 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:12.759525 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-39939868-19fd-484b-a966-413235d84d39 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:12.765888 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-39939868-19fd-484b-a966-413235d84d39 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:12.767002 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-39939868-19fd-484b-a966-413235d84d39 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:12.768329 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-39939868-19fd-484b-a966-413235d84d39 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:12.768436 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7a893d04-65f3-486e-b862-5b08d1971391 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:12.768760 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-39939868-19fd-484b-a966-413235d84d39 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:12.770039 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7a893d04-65f3-486e-b862-5b08d1971391 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:12.771213 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7a893d04-65f3-486e-b862-5b08d1971391 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1724 microversion: 2.20 time: 0.163072 Aug 01 14:22:12.771792 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 113/213] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:12 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:12.901302 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-39939868-19fd-484b-a966-413235d84d39 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:12.909133 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-39939868-19fd-484b-a966-413235d84d39 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1314 microversion: 2.1 time: 0.154912 Aug 01 14:22:12.909700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 101/214] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:12 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:13.166366 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-45f7127d-4ec2-42f3-a640-e015b86dabe2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:13.166971 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-45f7127d-4ec2-42f3-a640-e015b86dabe2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:13.173040 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-45f7127d-4ec2-42f3-a640-e015b86dabe2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:13.173981 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-45f7127d-4ec2-42f3-a640-e015b86dabe2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:13.174740 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-45f7127d-4ec2-42f3-a640-e015b86dabe2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:13.175173 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-45f7127d-4ec2-42f3-a640-e015b86dabe2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:13.311948 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-45f7127d-4ec2-42f3-a640-e015b86dabe2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:13.320009 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-45f7127d-4ec2-42f3-a640-e015b86dabe2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.157509 Aug 01 14:22:13.320574 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 114/215] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:13 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:13.794015 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9038b3e2-bba3-4fa9-a0bd-513b80493cc0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:13.794652 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9038b3e2-bba3-4fa9-a0bd-513b80493cc0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:13.801337 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9038b3e2-bba3-4fa9-a0bd-513b80493cc0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:13.801788 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9038b3e2-bba3-4fa9-a0bd-513b80493cc0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:13.802549 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9038b3e2-bba3-4fa9-a0bd-513b80493cc0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:13.802984 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9038b3e2-bba3-4fa9-a0bd-513b80493cc0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:13.930531 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-372c501a-d4c3-4d66-8153-23668dae3816 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:13.931150 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-372c501a-d4c3-4d66-8153-23668dae3816 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:13.937617 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-372c501a-d4c3-4d66-8153-23668dae3816 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:13.937847 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9038b3e2-bba3-4fa9-a0bd-513b80493cc0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:13.938057 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-372c501a-d4c3-4d66-8153-23668dae3816 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:13.938825 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-372c501a-d4c3-4d66-8153-23668dae3816 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:13.939855 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-372c501a-d4c3-4d66-8153-23668dae3816 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:13.946594 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9038b3e2-bba3-4fa9-a0bd-513b80493cc0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:13.948163 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9038b3e2-bba3-4fa9-a0bd-513b80493cc0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:13.949325 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9038b3e2-bba3-4fa9-a0bd-513b80493cc0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1724 microversion: 2.20 time: 0.159199 Aug 01 14:22:13.950071 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 102/216] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:13 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:14.077051 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-372c501a-d4c3-4d66-8153-23668dae3816 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:14.084484 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-372c501a-d4c3-4d66-8153-23668dae3816 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1314 microversion: 2.1 time: 0.157991 Aug 01 14:22:14.085036 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 115/217] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:13 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:14.340621 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-238956fc-9153-4d0e-8c88-9c2ed5044e79 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:14.341251 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-238956fc-9153-4d0e-8c88-9c2ed5044e79 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:14.348246 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-238956fc-9153-4d0e-8c88-9c2ed5044e79 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:14.348697 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-238956fc-9153-4d0e-8c88-9c2ed5044e79 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:14.349464 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-238956fc-9153-4d0e-8c88-9c2ed5044e79 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:14.349930 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-238956fc-9153-4d0e-8c88-9c2ed5044e79 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:14.479337 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-238956fc-9153-4d0e-8c88-9c2ed5044e79 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:14.488424 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-238956fc-9153-4d0e-8c88-9c2ed5044e79 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.151526 Aug 01 14:22:14.489006 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 103/218] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:14 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:14.973176 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-14686f89-d264-4e60-9938-cd78964d2ee9 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:14.973779 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-14686f89-d264-4e60-9938-cd78964d2ee9 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:14.975686 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:14.976445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=8 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:14.977740 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:14.984729 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-14686f89-d264-4e60-9938-cd78964d2ee9 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:14.985174 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-14686f89-d264-4e60-9938-cd78964d2ee9 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:14.986152 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-14686f89-d264-4e60-9938-cd78964d2ee9 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:14.986592 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-14686f89-d264-4e60-9938-cd78964d2ee9 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:15.106383 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-31e14405-92fb-44d9-ab93-9e9683429e43 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:15.107804 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-31e14405-92fb-44d9-ab93-9e9683429e43 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:15.114264 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-31e14405-92fb-44d9-ab93-9e9683429e43 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:15.116054 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-31e14405-92fb-44d9-ab93-9e9683429e43 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:15.117022 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-31e14405-92fb-44d9-ab93-9e9683429e43 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:15.117451 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-31e14405-92fb-44d9-ab93-9e9683429e43 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:15.265282 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-31e14405-92fb-44d9-ab93-9e9683429e43 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:15.273832 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-31e14405-92fb-44d9-ab93-9e9683429e43 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1314 microversion: 2.1 time: 0.171310 Aug 01 14:22:15.274410 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 104/219] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:15 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:15.286582 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-14686f89-d264-4e60-9938-cd78964d2ee9 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:15.295206 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-14686f89-d264-4e60-9938-cd78964d2ee9 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:15.297124 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-14686f89-d264-4e60-9938-cd78964d2ee9 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:15.298386 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-14686f89-d264-4e60-9938-cd78964d2ee9 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1724 microversion: 2.20 time: 0.329907 Aug 01 14:22:15.301064 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 116/220] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:14 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1724 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:22:15.509786 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-32f48f17-da76-468f-b927-69eb8daa1c79 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:15.510398 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-32f48f17-da76-468f-b927-69eb8daa1c79 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:15.516631 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-32f48f17-da76-468f-b927-69eb8daa1c79 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:15.517075 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-32f48f17-da76-468f-b927-69eb8daa1c79 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:15.517856 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-32f48f17-da76-468f-b927-69eb8daa1c79 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:15.518276 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-32f48f17-da76-468f-b927-69eb8daa1c79 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:15.668141 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-32f48f17-da76-468f-b927-69eb8daa1c79 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:15.677734 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-32f48f17-da76-468f-b927-69eb8daa1c79 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.171850 Aug 01 14:22:15.678720 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 105/221] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:15 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:16.294757 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5c4e4b9d-526c-49d1-9770-d37249c7201e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:16.295371 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5c4e4b9d-526c-49d1-9770-d37249c7201e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:16.302163 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5c4e4b9d-526c-49d1-9770-d37249c7201e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:16.302577 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5c4e4b9d-526c-49d1-9770-d37249c7201e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:16.303352 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5c4e4b9d-526c-49d1-9770-d37249c7201e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:16.303812 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5c4e4b9d-526c-49d1-9770-d37249c7201e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:16.323890 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-34272e27-2167-45cc-be68-0229e3e247c1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:16.324932 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-34272e27-2167-45cc-be68-0229e3e247c1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:16.331912 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-34272e27-2167-45cc-be68-0229e3e247c1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:16.332341 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-34272e27-2167-45cc-be68-0229e3e247c1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:16.333098 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-34272e27-2167-45cc-be68-0229e3e247c1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:16.333534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-34272e27-2167-45cc-be68-0229e3e247c1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:16.452570 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5c4e4b9d-526c-49d1-9770-d37249c7201e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:16.460562 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5c4e4b9d-526c-49d1-9770-d37249c7201e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1314 microversion: 2.1 time: 0.169838 Aug 01 14:22:16.461135 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 117/222] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:16 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:16.476810 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-34272e27-2167-45cc-be68-0229e3e247c1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:16.484926 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-34272e27-2167-45cc-be68-0229e3e247c1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:16.486732 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-34272e27-2167-45cc-be68-0229e3e247c1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:16.488000 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-34272e27-2167-45cc-be68-0229e3e247c1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1724 microversion: 2.20 time: 0.168346 Aug 01 14:22:16.488729 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 106/223] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:16 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:22:16.700374 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-99e99406-d681-4331-9e63-46ddb4601bf4 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:16.700881 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-99e99406-d681-4331-9e63-46ddb4601bf4 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:16.708352 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-99e99406-d681-4331-9e63-46ddb4601bf4 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:16.708934 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-99e99406-d681-4331-9e63-46ddb4601bf4 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:16.709711 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-99e99406-d681-4331-9e63-46ddb4601bf4 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:16.710173 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-99e99406-d681-4331-9e63-46ddb4601bf4 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:16.714416 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=100 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:16.845706 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-99e99406-d681-4331-9e63-46ddb4601bf4 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:16.853755 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-99e99406-d681-4331-9e63-46ddb4601bf4 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.157342 Aug 01 14:22:16.854343 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 118/224] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:16 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:17.483488 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9c18b79e-f404-423e-a4c1-14938bdb198e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:17.484479 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9c18b79e-f404-423e-a4c1-14938bdb198e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:17.492565 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9c18b79e-f404-423e-a4c1-14938bdb198e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:17.493081 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9c18b79e-f404-423e-a4c1-14938bdb198e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:17.493999 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9c18b79e-f404-423e-a4c1-14938bdb198e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:17.495611 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9c18b79e-f404-423e-a4c1-14938bdb198e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:17.510788 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6a7fe841-259a-4533-a73c-4af12cba7dbe tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:17.511647 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-6a7fe841-259a-4533-a73c-4af12cba7dbe tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:17.519104 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6a7fe841-259a-4533-a73c-4af12cba7dbe tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:17.519708 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6a7fe841-259a-4533-a73c-4af12cba7dbe tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:17.520726 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6a7fe841-259a-4533-a73c-4af12cba7dbe tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:17.521394 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6a7fe841-259a-4533-a73c-4af12cba7dbe tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:17.636079 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9c18b79e-f404-423e-a4c1-14938bdb198e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:17.644865 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9c18b79e-f404-423e-a4c1-14938bdb198e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1314 microversion: 2.1 time: 0.166271 Aug 01 14:22:17.645453 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 107/225] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:17 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:17.671816 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6a7fe841-259a-4533-a73c-4af12cba7dbe tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:17.680157 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6a7fe841-259a-4533-a73c-4af12cba7dbe tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:17.681653 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6a7fe841-259a-4533-a73c-4af12cba7dbe tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:17.682783 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6a7fe841-259a-4533-a73c-4af12cba7dbe tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1724 microversion: 2.20 time: 0.176491 Aug 01 14:22:17.683347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 119/226] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:17 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:22:17.874038 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-234a5a33-7258-4255-b87d-c33d57dec334 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:17.874644 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-234a5a33-7258-4255-b87d-c33d57dec334 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:17.881300 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-234a5a33-7258-4255-b87d-c33d57dec334 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:17.881748 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-234a5a33-7258-4255-b87d-c33d57dec334 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:17.882501 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-234a5a33-7258-4255-b87d-c33d57dec334 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:17.882931 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-234a5a33-7258-4255-b87d-c33d57dec334 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:18.009789 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-234a5a33-7258-4255-b87d-c33d57dec334 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:18.017221 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-234a5a33-7258-4255-b87d-c33d57dec334 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.146989 Aug 01 14:22:18.017785 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 108/227] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:17 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:18.665849 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ed0b4fb9-a351-4022-9a3a-87b7805babf6 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:18.666455 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ed0b4fb9-a351-4022-9a3a-87b7805babf6 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:18.672966 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ed0b4fb9-a351-4022-9a3a-87b7805babf6 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:18.673449 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ed0b4fb9-a351-4022-9a3a-87b7805babf6 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:18.674214 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ed0b4fb9-a351-4022-9a3a-87b7805babf6 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:18.674646 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ed0b4fb9-a351-4022-9a3a-87b7805babf6 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:18.706826 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7a994e6c-48ac-454b-97aa-8599142aaebd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:18.707767 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7a994e6c-48ac-454b-97aa-8599142aaebd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:18.714470 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7a994e6c-48ac-454b-97aa-8599142aaebd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:18.714912 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7a994e6c-48ac-454b-97aa-8599142aaebd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:18.715712 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7a994e6c-48ac-454b-97aa-8599142aaebd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:18.716140 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7a994e6c-48ac-454b-97aa-8599142aaebd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:18.859267 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7a994e6c-48ac-454b-97aa-8599142aaebd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:18.869151 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7a994e6c-48ac-454b-97aa-8599142aaebd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:18.870682 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7a994e6c-48ac-454b-97aa-8599142aaebd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:18.871930 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7a994e6c-48ac-454b-97aa-8599142aaebd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1724 microversion: 2.20 time: 0.169720 Aug 01 14:22:18.872502 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 109/228] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:18 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:22:18.981314 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ed0b4fb9-a351-4022-9a3a-87b7805babf6 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:18.989621 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ed0b4fb9-a351-4022-9a3a-87b7805babf6 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1314 microversion: 2.1 time: 0.327445 Aug 01 14:22:18.990112 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 120/229] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:18 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:19.038737 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4ae4f9cf-8826-4d4d-8be2-6b5529507897 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:19.039405 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4ae4f9cf-8826-4d4d-8be2-6b5529507897 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:19.045985 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ae4f9cf-8826-4d4d-8be2-6b5529507897 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:19.046432 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ae4f9cf-8826-4d4d-8be2-6b5529507897 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:19.047208 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ae4f9cf-8826-4d4d-8be2-6b5529507897 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:19.047718 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ae4f9cf-8826-4d4d-8be2-6b5529507897 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:19.209343 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4ae4f9cf-8826-4d4d-8be2-6b5529507897 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:19.218041 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4ae4f9cf-8826-4d4d-8be2-6b5529507897 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.183297 Aug 01 14:22:19.218824 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 110/230] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:19 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:19.894352 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f2156842-8641-4d1e-b86c-2bcbb50bc1bb tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:19.895009 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f2156842-8641-4d1e-b86c-2bcbb50bc1bb tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:19.901561 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f2156842-8641-4d1e-b86c-2bcbb50bc1bb tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:19.902013 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f2156842-8641-4d1e-b86c-2bcbb50bc1bb tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:19.902767 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f2156842-8641-4d1e-b86c-2bcbb50bc1bb tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:19.903253 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f2156842-8641-4d1e-b86c-2bcbb50bc1bb tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:20.012202 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-12dc62af-f7ca-402b-aedb-b11d3b18f73d tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:20.012816 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-12dc62af-f7ca-402b-aedb-b11d3b18f73d tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:20.019845 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-12dc62af-f7ca-402b-aedb-b11d3b18f73d tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:20.020293 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-12dc62af-f7ca-402b-aedb-b11d3b18f73d tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:20.021071 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-12dc62af-f7ca-402b-aedb-b11d3b18f73d tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:20.021507 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-12dc62af-f7ca-402b-aedb-b11d3b18f73d tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:20.170223 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-12dc62af-f7ca-402b-aedb-b11d3b18f73d tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:20.174216 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f2156842-8641-4d1e-b86c-2bcbb50bc1bb tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:20.179448 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-12dc62af-f7ca-402b-aedb-b11d3b18f73d tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1314 microversion: 2.1 time: 0.171143 Aug 01 14:22:20.180126 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 111/231] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:20 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:20.182984 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f2156842-8641-4d1e-b86c-2bcbb50bc1bb tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:20.184526 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f2156842-8641-4d1e-b86c-2bcbb50bc1bb tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:20.185817 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f2156842-8641-4d1e-b86c-2bcbb50bc1bb tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1724 microversion: 2.20 time: 0.295963 Aug 01 14:22:20.186558 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 121/232] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:19 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1724 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:20.240008 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d0c5a9d1-8e7e-486a-b212-785cc5fa6449 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:20.240603 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d0c5a9d1-8e7e-486a-b212-785cc5fa6449 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:20.246499 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d0c5a9d1-8e7e-486a-b212-785cc5fa6449 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:20.246941 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d0c5a9d1-8e7e-486a-b212-785cc5fa6449 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:20.247711 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d0c5a9d1-8e7e-486a-b212-785cc5fa6449 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:20.248136 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d0c5a9d1-8e7e-486a-b212-785cc5fa6449 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:20.384793 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d0c5a9d1-8e7e-486a-b212-785cc5fa6449 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:20.392644 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d0c5a9d1-8e7e-486a-b212-785cc5fa6449 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.157073 Aug 01 14:22:20.393464 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 112/233] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:20 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:21.200870 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-68d86e69-8d00-4693-b3d9-dc8c9de0a6a8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:21.201599 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-68d86e69-8d00-4693-b3d9-dc8c9de0a6a8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:21.208726 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-68d86e69-8d00-4693-b3d9-dc8c9de0a6a8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:21.209173 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-68d86e69-8d00-4693-b3d9-dc8c9de0a6a8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:21.209311 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d8f4805a-f7fe-4ec9-9507-c4590e72458b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:21.209917 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d8f4805a-f7fe-4ec9-9507-c4590e72458b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:21.210030 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-68d86e69-8d00-4693-b3d9-dc8c9de0a6a8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:21.210359 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-68d86e69-8d00-4693-b3d9-dc8c9de0a6a8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:21.216556 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d8f4805a-f7fe-4ec9-9507-c4590e72458b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:21.217011 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d8f4805a-f7fe-4ec9-9507-c4590e72458b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:21.217810 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d8f4805a-f7fe-4ec9-9507-c4590e72458b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:21.218230 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d8f4805a-f7fe-4ec9-9507-c4590e72458b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:21.351573 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-68d86e69-8d00-4693-b3d9-dc8c9de0a6a8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:21.356421 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d8f4805a-f7fe-4ec9-9507-c4590e72458b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:21.360117 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-68d86e69-8d00-4693-b3d9-dc8c9de0a6a8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1314 microversion: 2.1 time: 0.163067 Aug 01 14:22:21.360899 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 122/234] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:21 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:21.365142 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d8f4805a-f7fe-4ec9-9507-c4590e72458b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:21.366750 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d8f4805a-f7fe-4ec9-9507-c4590e72458b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:21.368019 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d8f4805a-f7fe-4ec9-9507-c4590e72458b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1724 microversion: 2.20 time: 0.162534 Aug 01 14:22:21.368565 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 113/235] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:21 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:22:21.419895 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-214519df-40d3-4136-b362-33f83b73d32b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:21.420510 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-214519df-40d3-4136-b362-33f83b73d32b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:21.427326 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-214519df-40d3-4136-b362-33f83b73d32b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:21.427803 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-214519df-40d3-4136-b362-33f83b73d32b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:21.428573 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-214519df-40d3-4136-b362-33f83b73d32b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:21.429002 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-214519df-40d3-4136-b362-33f83b73d32b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:21.558336 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-214519df-40d3-4136-b362-33f83b73d32b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:21.566960 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-214519df-40d3-4136-b362-33f83b73d32b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.150812 Aug 01 14:22:21.567542 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 123/236] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:21 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:22.382252 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f3864842-ce8b-4432-9e22-4b0d6c576737 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:22.383885 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f3864842-ce8b-4432-9e22-4b0d6c576737 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:22.391364 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f3864842-ce8b-4432-9e22-4b0d6c576737 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:22.392846 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f3864842-ce8b-4432-9e22-4b0d6c576737 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:22.393113 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-2192dcfe-dcf8-425e-aadb-8d16538ae805 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:22.394500 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f3864842-ce8b-4432-9e22-4b0d6c576737 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:22.395162 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f3864842-ce8b-4432-9e22-4b0d6c576737 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:22.395471 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-2192dcfe-dcf8-425e-aadb-8d16538ae805 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:22.406718 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2192dcfe-dcf8-425e-aadb-8d16538ae805 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:22.408392 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2192dcfe-dcf8-425e-aadb-8d16538ae805 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:22.409575 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2192dcfe-dcf8-425e-aadb-8d16538ae805 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:22.409999 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2192dcfe-dcf8-425e-aadb-8d16538ae805 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:22.419930 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=100 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:22.547154 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f3864842-ce8b-4432-9e22-4b0d6c576737 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:22.553658 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2192dcfe-dcf8-425e-aadb-8d16538ae805 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:22.555124 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f3864842-ce8b-4432-9e22-4b0d6c576737 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1314 microversion: 2.1 time: 0.176810 Aug 01 14:22:22.555739 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 114/237] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:22 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:22.562334 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2192dcfe-dcf8-425e-aadb-8d16538ae805 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:22.564657 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2192dcfe-dcf8-425e-aadb-8d16538ae805 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:22.565928 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-2192dcfe-dcf8-425e-aadb-8d16538ae805 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1724 microversion: 2.20 time: 0.177917 Aug 01 14:22:22.566494 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 124/238] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:22 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:22.587829 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-cfd8b26d-e8cd-42db-8049-13a5e072002b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:22.588426 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-cfd8b26d-e8cd-42db-8049-13a5e072002b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:22.594683 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cfd8b26d-e8cd-42db-8049-13a5e072002b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:22.595171 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cfd8b26d-e8cd-42db-8049-13a5e072002b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:22.595955 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cfd8b26d-e8cd-42db-8049-13a5e072002b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:22.596645 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cfd8b26d-e8cd-42db-8049-13a5e072002b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:22.746744 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-cfd8b26d-e8cd-42db-8049-13a5e072002b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:22.755345 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-cfd8b26d-e8cd-42db-8049-13a5e072002b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.171340 Aug 01 14:22:22.755972 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 115/239] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:22 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:23.576998 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d330b6dc-b95a-48df-b151-9d0c56cc8579 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:23.577789 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d330b6dc-b95a-48df-b151-9d0c56cc8579 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:23.586625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d330b6dc-b95a-48df-b151-9d0c56cc8579 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:23.587061 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d330b6dc-b95a-48df-b151-9d0c56cc8579 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:23.587902 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d330b6dc-b95a-48df-b151-9d0c56cc8579 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:23.588274 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d330b6dc-b95a-48df-b151-9d0c56cc8579 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:23.590213 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-03ce1906-c43e-4eac-a1c0-0a3b9fdebeae tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:23.590813 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-03ce1906-c43e-4eac-a1c0-0a3b9fdebeae tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:23.598886 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-03ce1906-c43e-4eac-a1c0-0a3b9fdebeae tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:23.599333 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-03ce1906-c43e-4eac-a1c0-0a3b9fdebeae tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:23.600248 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-03ce1906-c43e-4eac-a1c0-0a3b9fdebeae tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:23.600680 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-03ce1906-c43e-4eac-a1c0-0a3b9fdebeae tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:23.735533 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d330b6dc-b95a-48df-b151-9d0c56cc8579 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:23.742830 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d330b6dc-b95a-48df-b151-9d0c56cc8579 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1314 microversion: 2.1 time: 0.170189 Aug 01 14:22:23.743435 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 125/240] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:23 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:23.750049 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-03ce1906-c43e-4eac-a1c0-0a3b9fdebeae tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:23.758601 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-03ce1906-c43e-4eac-a1c0-0a3b9fdebeae tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:23.760117 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-03ce1906-c43e-4eac-a1c0-0a3b9fdebeae tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:23.761273 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-03ce1906-c43e-4eac-a1c0-0a3b9fdebeae tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1724 microversion: 2.20 time: 0.174927 Aug 01 14:22:23.761836 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 116/241] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:23 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:23.777150 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8622f337-f2d2-47ca-8e7d-86b01592ca03 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:23.777759 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8622f337-f2d2-47ca-8e7d-86b01592ca03 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:23.784789 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8622f337-f2d2-47ca-8e7d-86b01592ca03 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:23.785233 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8622f337-f2d2-47ca-8e7d-86b01592ca03 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:23.786007 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8622f337-f2d2-47ca-8e7d-86b01592ca03 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:23.786445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8622f337-f2d2-47ca-8e7d-86b01592ca03 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:23.932537 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8622f337-f2d2-47ca-8e7d-86b01592ca03 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:23.941881 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8622f337-f2d2-47ca-8e7d-86b01592ca03 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.168569 Aug 01 14:22:23.942465 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 126/242] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:23 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:24.763832 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-235946b3-63fb-4266-9b4a-ebdfb2d0aa08 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:24.764426 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-235946b3-63fb-4266-9b4a-ebdfb2d0aa08 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:24.770912 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-235946b3-63fb-4266-9b4a-ebdfb2d0aa08 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:24.771330 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-235946b3-63fb-4266-9b4a-ebdfb2d0aa08 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:24.772104 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-235946b3-63fb-4266-9b4a-ebdfb2d0aa08 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:24.772529 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-235946b3-63fb-4266-9b4a-ebdfb2d0aa08 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:24.785603 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5bbb30b3-ef79-47ae-ad3f-ec5fa62d7bb8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:24.786219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5bbb30b3-ef79-47ae-ad3f-ec5fa62d7bb8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:24.793269 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5bbb30b3-ef79-47ae-ad3f-ec5fa62d7bb8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:24.793721 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5bbb30b3-ef79-47ae-ad3f-ec5fa62d7bb8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:24.794505 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5bbb30b3-ef79-47ae-ad3f-ec5fa62d7bb8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:24.794942 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5bbb30b3-ef79-47ae-ad3f-ec5fa62d7bb8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:24.935840 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5bbb30b3-ef79-47ae-ad3f-ec5fa62d7bb8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:24.944035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5bbb30b3-ef79-47ae-ad3f-ec5fa62d7bb8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:24.945562 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5bbb30b3-ef79-47ae-ad3f-ec5fa62d7bb8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:24.946728 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5bbb30b3-ef79-47ae-ad3f-ec5fa62d7bb8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1724 microversion: 2.20 time: 0.165735 Aug 01 14:22:24.947295 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 127/243] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:24 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:22:24.962009 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0d92de64-11ba-41df-8a1f-c03a79f7371e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:24.962703 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0d92de64-11ba-41df-8a1f-c03a79f7371e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:24.969023 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0d92de64-11ba-41df-8a1f-c03a79f7371e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:24.969481 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0d92de64-11ba-41df-8a1f-c03a79f7371e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:24.970782 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0d92de64-11ba-41df-8a1f-c03a79f7371e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:24.971511 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0d92de64-11ba-41df-8a1f-c03a79f7371e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:25.049220 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-235946b3-63fb-4266-9b4a-ebdfb2d0aa08 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:25.056540 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-235946b3-63fb-4266-9b4a-ebdfb2d0aa08 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1314 microversion: 2.1 time: 0.296512 Aug 01 14:22:25.057105 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 117/244] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:24 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:25.112132 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0d92de64-11ba-41df-8a1f-c03a79f7371e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:25.119590 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0d92de64-11ba-41df-8a1f-c03a79f7371e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.161357 Aug 01 14:22:25.120157 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 128/245] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:24 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:25.969585 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ca427302-70a8-4aed-9bec-3910fae1ddca tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:25.970183 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ca427302-70a8-4aed-9bec-3910fae1ddca tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:25.976982 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ca427302-70a8-4aed-9bec-3910fae1ddca tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:25.977427 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ca427302-70a8-4aed-9bec-3910fae1ddca tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:25.978181 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ca427302-70a8-4aed-9bec-3910fae1ddca tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:25.978611 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ca427302-70a8-4aed-9bec-3910fae1ddca tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:26.078307 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5ffec3e0-386e-463f-b2b9-e2cedefdd9c5 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:26.078931 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5ffec3e0-386e-463f-b2b9-e2cedefdd9c5 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:26.085513 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5ffec3e0-386e-463f-b2b9-e2cedefdd9c5 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:26.085744 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5ffec3e0-386e-463f-b2b9-e2cedefdd9c5 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:26.086572 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5ffec3e0-386e-463f-b2b9-e2cedefdd9c5 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:26.087004 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5ffec3e0-386e-463f-b2b9-e2cedefdd9c5 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:26.110234 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ca427302-70a8-4aed-9bec-3910fae1ddca tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:26.118877 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ca427302-70a8-4aed-9bec-3910fae1ddca tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:26.120491 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ca427302-70a8-4aed-9bec-3910fae1ddca tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:26.121671 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ca427302-70a8-4aed-9bec-3910fae1ddca tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1724 microversion: 2.20 time: 0.155986 Aug 01 14:22:26.122229 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 118/246] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:25 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:26.145846 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-394a52c5-76ab-4805-be9e-a2fbf9f0aa87 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:26.146510 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-394a52c5-76ab-4805-be9e-a2fbf9f0aa87 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:26.154282 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-394a52c5-76ab-4805-be9e-a2fbf9f0aa87 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:26.154733 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-394a52c5-76ab-4805-be9e-a2fbf9f0aa87 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:26.155527 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-394a52c5-76ab-4805-be9e-a2fbf9f0aa87 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:26.155958 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-394a52c5-76ab-4805-be9e-a2fbf9f0aa87 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:26.223775 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5ffec3e0-386e-463f-b2b9-e2cedefdd9c5 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:26.232219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5ffec3e0-386e-463f-b2b9-e2cedefdd9c5 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1314 microversion: 2.1 time: 0.157916 Aug 01 14:22:26.232808 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 129/247] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:26 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:26.295736 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-394a52c5-76ab-4805-be9e-a2fbf9f0aa87 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:26.303213 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-394a52c5-76ab-4805-be9e-a2fbf9f0aa87 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.162296 Aug 01 14:22:26.303827 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 119/248] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:26 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:27.146511 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-937e7bdd-fcf4-4aa5-b503-095fcf0b8039 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:27.147113 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-937e7bdd-fcf4-4aa5-b503-095fcf0b8039 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:27.154023 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-937e7bdd-fcf4-4aa5-b503-095fcf0b8039 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:27.154472 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-937e7bdd-fcf4-4aa5-b503-095fcf0b8039 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:27.155249 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-937e7bdd-fcf4-4aa5-b503-095fcf0b8039 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:27.155700 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-937e7bdd-fcf4-4aa5-b503-095fcf0b8039 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:27.254319 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9a24d221-f103-423d-9d66-3a69b32c85ff tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:27.254844 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9a24d221-f103-423d-9d66-3a69b32c85ff tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:27.261476 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9a24d221-f103-423d-9d66-3a69b32c85ff tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:27.262151 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9a24d221-f103-423d-9d66-3a69b32c85ff tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:27.262940 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9a24d221-f103-423d-9d66-3a69b32c85ff tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:27.263497 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9a24d221-f103-423d-9d66-3a69b32c85ff tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:27.303046 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-937e7bdd-fcf4-4aa5-b503-095fcf0b8039 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:27.321825 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-937e7bdd-fcf4-4aa5-b503-095fcf0b8039 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:27.323447 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-937e7bdd-fcf4-4aa5-b503-095fcf0b8039 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:27.324866 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-937e7bdd-fcf4-4aa5-b503-095fcf0b8039 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1724 microversion: 2.20 time: 0.182700 Aug 01 14:22:27.325430 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 130/249] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:27 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:27.330696 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-227919b9-4ba1-4ae3-93dd-b4d3d056d946 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:27.331302 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-227919b9-4ba1-4ae3-93dd-b4d3d056d946 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:27.338464 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-227919b9-4ba1-4ae3-93dd-b4d3d056d946 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:27.338922 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-227919b9-4ba1-4ae3-93dd-b4d3d056d946 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:27.339724 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-227919b9-4ba1-4ae3-93dd-b4d3d056d946 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:27.340157 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-227919b9-4ba1-4ae3-93dd-b4d3d056d946 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:27.414649 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9a24d221-f103-423d-9d66-3a69b32c85ff tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:27.422702 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9a24d221-f103-423d-9d66-3a69b32c85ff tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1314 microversion: 2.1 time: 0.173753 Aug 01 14:22:27.423898 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 120/250] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:27 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:27.479247 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-227919b9-4ba1-4ae3-93dd-b4d3d056d946 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:27.486811 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-227919b9-4ba1-4ae3-93dd-b4d3d056d946 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.160431 Aug 01 14:22:27.487374 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 131/251] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:27 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:28.353641 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-74a6fdc8-31fe-4b6c-bace-d8c066a38daa tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:28.355203 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-74a6fdc8-31fe-4b6c-bace-d8c066a38daa tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:28.365175 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-74a6fdc8-31fe-4b6c-bace-d8c066a38daa tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:28.366632 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-74a6fdc8-31fe-4b6c-bace-d8c066a38daa tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:28.368225 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-74a6fdc8-31fe-4b6c-bace-d8c066a38daa tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:28.369036 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-74a6fdc8-31fe-4b6c-bace-d8c066a38daa tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:28.447558 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-dbd3871c-18b3-497a-8fec-71a964cb7576 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:28.448798 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-dbd3871c-18b3-497a-8fec-71a964cb7576 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:28.457551 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dbd3871c-18b3-497a-8fec-71a964cb7576 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:28.457997 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dbd3871c-18b3-497a-8fec-71a964cb7576 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:28.458762 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dbd3871c-18b3-497a-8fec-71a964cb7576 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:28.459189 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dbd3871c-18b3-497a-8fec-71a964cb7576 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:28.553876 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-74a6fdc8-31fe-4b6c-bace-d8c066a38daa tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:28.561925 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-74a6fdc8-31fe-4b6c-bace-d8c066a38daa tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:28.563961 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-74a6fdc8-31fe-4b6c-bace-d8c066a38daa tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:28.565344 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-74a6fdc8-31fe-4b6c-bace-d8c066a38daa tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1745 microversion: 2.20 time: 0.217573 Aug 01 14:22:28.566097 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 121/252] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:28 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1745 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:28.570868 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-cd9e96dc-553d-4f12-ba1e-36cccc791ae1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:28.571703 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-cd9e96dc-553d-4f12-ba1e-36cccc791ae1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:28.580890 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cd9e96dc-553d-4f12-ba1e-36cccc791ae1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:28.581353 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cd9e96dc-553d-4f12-ba1e-36cccc791ae1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:28.582143 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cd9e96dc-553d-4f12-ba1e-36cccc791ae1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:28.582577 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cd9e96dc-553d-4f12-ba1e-36cccc791ae1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:28.619553 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-dbd3871c-18b3-497a-8fec-71a964cb7576 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:28.630561 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-dbd3871c-18b3-497a-8fec-71a964cb7576 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1314 microversion: 2.1 time: 0.189012 Aug 01 14:22:28.631505 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 132/253] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:28 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:28.748654 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-cd9e96dc-553d-4f12-ba1e-36cccc791ae1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:28.757227 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-cd9e96dc-553d-4f12-ba1e-36cccc791ae1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.189879 Aug 01 14:22:28.757798 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 122/254] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:28 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:28.760336 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-874e1136-5000-4dac-827d-e255636a8451 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Action: 'create', calling method: .version_select at 0x7f6185e19430>, body: {"keypair": {"name": "tempest-keypair-351306984", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQbKEtG83+6N4GOFXhekbiRrMYfhXiUaIVRD9f10K8025y9xIs+S4KOG8wbKI8eG7tZA9xDm2M159bFRH+JvUMLl5hm36ILi55CjtghN+SPji/uQNr1xrnLBvjElkToMA=="}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:28.781776 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-874e1136-5000-4dac-827d-e255636a8451 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Getting quotas for project 3092982f3c6f4851a5a6e84bf7872d11. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:22:28.786577 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-874e1136-5000-4dac-827d-e255636a8451 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Getting quotas for user 9eda4e19122444cf9cb2b6941adff9d5 and project 3092982f3c6f4851a5a6e84bf7872d11. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:22:28.843705 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-874e1136-5000-4dac-827d-e255636a8451 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.088269 Aug 01 14:22:28.844485 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 133/255] 10.222.0.17 () {60 vars in 1159 bytes} [Mon Aug 1 14:22:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:22:29.592136 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-37f94a89-67cf-4eff-85bf-cf38186aa1c8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:29.593160 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-37f94a89-67cf-4eff-85bf-cf38186aa1c8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:29.603661 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-37f94a89-67cf-4eff-85bf-cf38186aa1c8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:29.604282 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-37f94a89-67cf-4eff-85bf-cf38186aa1c8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:29.605337 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-37f94a89-67cf-4eff-85bf-cf38186aa1c8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:29.605883 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-37f94a89-67cf-4eff-85bf-cf38186aa1c8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:29.654721 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a59d7bf4-88db-464b-a324-e4ffc54ac6ae tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:29.656314 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a59d7bf4-88db-464b-a324-e4ffc54ac6ae tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:29.665610 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a59d7bf4-88db-464b-a324-e4ffc54ac6ae tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:29.666175 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a59d7bf4-88db-464b-a324-e4ffc54ac6ae tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:29.667074 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a59d7bf4-88db-464b-a324-e4ffc54ac6ae tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:29.667640 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a59d7bf4-88db-464b-a324-e4ffc54ac6ae tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:29.792067 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-37f94a89-67cf-4eff-85bf-cf38186aa1c8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:29.801802 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-37f94a89-67cf-4eff-85bf-cf38186aa1c8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:29.803486 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-37f94a89-67cf-4eff-85bf-cf38186aa1c8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:29.804864 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-37f94a89-67cf-4eff-85bf-cf38186aa1c8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1745 microversion: 2.20 time: 0.219311 Aug 01 14:22:29.805436 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 123/256] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:29 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1745 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:29.811095 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-da2d1a7f-3058-47d0-bfab-cf65655af707 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:29.812189 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-da2d1a7f-3058-47d0-bfab-cf65655af707 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:29.820850 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-da2d1a7f-3058-47d0-bfab-cf65655af707 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:29.821811 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-da2d1a7f-3058-47d0-bfab-cf65655af707 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:29.823328 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-da2d1a7f-3058-47d0-bfab-cf65655af707 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:29.825457 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-da2d1a7f-3058-47d0-bfab-cf65655af707 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:29.998620 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-da2d1a7f-3058-47d0-bfab-cf65655af707 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:30.007215 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a59d7bf4-88db-464b-a324-e4ffc54ac6ae tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:30.009457 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-da2d1a7f-3058-47d0-bfab-cf65655af707 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.202267 Aug 01 14:22:30.027683 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 124/257] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:29 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:30.032482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a59d7bf4-88db-464b-a324-e4ffc54ac6ae tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1314 microversion: 2.1 time: 0.382842 Aug 01 14:22:30.033221 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 134/258] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:29 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:30.647440 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ced5ae80-ada8-4247-9e1e-7409cb99aa90 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:30.647983 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ced5ae80-ada8-4247-9e1e-7409cb99aa90 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:30.657979 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ced5ae80-ada8-4247-9e1e-7409cb99aa90 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:30.658838 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ced5ae80-ada8-4247-9e1e-7409cb99aa90 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:30.659899 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ced5ae80-ada8-4247-9e1e-7409cb99aa90 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:30.660566 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ced5ae80-ada8-4247-9e1e-7409cb99aa90 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:30.799009 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-ced5ae80-ada8-4247-9e1e-7409cb99aa90 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lazy-loading 'services' on Instance uuid 4345a2fe-05f1-4129-84c7-0bc44c0fdff4 {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:22:30.800429 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-acca7bd3-d978-4211-a29f-ee32241b4452 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-508544847", "imageRef": "9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de859ae5-345c-4f53-adf9-d10ff3cac7a2"}], "security_groups": [{"name": "tempest-securitygroup--1903113051"}], "key_name": "tempest-keypair-351306984", "user_data": "}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:30.911676 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.network.neutron [None req-acca7bd3-d978-4211-a29f-ee32241b4452 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] validate_networks() for [('de859ae5-345c-4f53-adf9-d10ff3cac7a2', None, None, None, None, None)] {{(pid=118133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:22:30.931620 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ced5ae80-ada8-4247-9e1e-7409cb99aa90 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4/os-volume_attachments/9ae8521a-03cd-49b4-b26d-3c8861fedd63" status: 202 len: 0 microversion: 2.1 time: 0.288031 Aug 01 14:22:30.932687 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 125/259] 10.222.0.17 () {58 vars in 1416 bytes} [Mon Aug 1 14:22:30 2022] DELETE /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4/os-volume_attachments/9ae8521a-03cd-49b4-b26d-3c8861fedd63 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:22:30.941882 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1572764d-962d-4bbc-9091-8fe61988189a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:30.942526 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-1572764d-962d-4bbc-9091-8fe61988189a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:30.950368 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1572764d-962d-4bbc-9091-8fe61988189a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:30.950822 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1572764d-962d-4bbc-9091-8fe61988189a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:30.951961 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1572764d-962d-4bbc-9091-8fe61988189a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:30.952407 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1572764d-962d-4bbc-9091-8fe61988189a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:31.091030 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1572764d-962d-4bbc-9091-8fe61988189a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:31.100411 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1572764d-962d-4bbc-9091-8fe61988189a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:31.101914 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1572764d-962d-4bbc-9091-8fe61988189a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:31.103144 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-1572764d-962d-4bbc-9091-8fe61988189a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1745 microversion: 2.20 time: 0.168627 Aug 01 14:22:31.103737 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 126/260] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:30 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:31.108562 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-070ce0b1-7fba-4b1a-9513-3cf724c27eef tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:31.109170 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-070ce0b1-7fba-4b1a-9513-3cf724c27eef tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:31.119835 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-070ce0b1-7fba-4b1a-9513-3cf724c27eef tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:31.120284 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-070ce0b1-7fba-4b1a-9513-3cf724c27eef tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:31.121054 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-070ce0b1-7fba-4b1a-9513-3cf724c27eef tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:31.121669 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-070ce0b1-7fba-4b1a-9513-3cf724c27eef tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:31.259789 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-070ce0b1-7fba-4b1a-9513-3cf724c27eef tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:31.267935 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-070ce0b1-7fba-4b1a-9513-3cf724c27eef tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.163152 Aug 01 14:22:31.268526 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 127/261] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:31 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:31.273155 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a2dec761-098b-4c07-907e-682b9c788b9a tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:31.273833 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a2dec761-098b-4c07-907e-682b9c788b9a tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:31.279788 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a2dec761-098b-4c07-907e-682b9c788b9a tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:31.280239 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a2dec761-098b-4c07-907e-682b9c788b9a tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:31.281174 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a2dec761-098b-4c07-907e-682b9c788b9a tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:31.281606 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a2dec761-098b-4c07-907e-682b9c788b9a tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:31.319749 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-acca7bd3-d978-4211-a29f-ee32241b4452 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Flavor limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:22:31.320173 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-acca7bd3-d978-4211-a29f-ee32241b4452 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Image limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:22:31.320641 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-acca7bd3-d978-4211-a29f-ee32241b4452 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Flavor pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:22:31.321041 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-acca7bd3-d978-4211-a29f-ee32241b4452 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Image pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:22:31.321444 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-acca7bd3-d978-4211-a29f-ee32241b4452 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:22:31.331482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-acca7bd3-d978-4211-a29f-ee32241b4452 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:31.332445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-acca7bd3-d978-4211-a29f-ee32241b4452 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:31.333271 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-acca7bd3-d978-4211-a29f-ee32241b4452 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:31.333702 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-acca7bd3-d978-4211-a29f-ee32241b4452 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:31.352271 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-acca7bd3-d978-4211-a29f-ee32241b4452 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Getting quotas for project 3092982f3c6f4851a5a6e84bf7872d11. Resources: {'instances', 'cores', 'ram'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:22:31.356547 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-acca7bd3-d978-4211-a29f-ee32241b4452 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Getting quotas for user 9eda4e19122444cf9cb2b6941adff9d5 and project 3092982f3c6f4851a5a6e84bf7872d11. Resources: {'instances', 'cores', 'ram'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:22:31.367781 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-acca7bd3-d978-4211-a29f-ee32241b4452 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Going to run 1 instances... {{(pid=118133) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:22:31.370027 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-acca7bd3-d978-4211-a29f-ee32241b4452 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:22:31.415778 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a2dec761-098b-4c07-907e-682b9c788b9a tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:31.419246 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-acca7bd3-d978-4211-a29f-ee32241b4452 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.623930 Aug 01 14:22:31.420185 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 135/262] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Aug 1 14:22:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:22:31.423958 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a2dec761-098b-4c07-907e-682b9c788b9a tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1314 microversion: 2.1 time: 0.154213 Aug 01 14:22:31.424772 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 128/263] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:31 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:31.433489 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ae2f3b3e-275a-490d-a06a-62abd8dde695 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:31.434312 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ae2f3b3e-275a-490d-a06a-62abd8dde695 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:31.491887 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ae2f3b3e-275a-490d-a06a-62abd8dde695 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:31.498961 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ae2f3b3e-275a-490d-a06a-62abd8dde695 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 200 len: 1240 microversion: 2.1 time: 0.069595 Aug 01 14:22:31.499837 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 136/264] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:31 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:32.128072 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-693aebb2-7e95-407c-b16e-d8b44f550b2d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:32.128678 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-693aebb2-7e95-407c-b16e-d8b44f550b2d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:32.135117 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-693aebb2-7e95-407c-b16e-d8b44f550b2d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:32.135599 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-693aebb2-7e95-407c-b16e-d8b44f550b2d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:32.136363 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-693aebb2-7e95-407c-b16e-d8b44f550b2d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:32.136795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-693aebb2-7e95-407c-b16e-d8b44f550b2d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:32.273727 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-693aebb2-7e95-407c-b16e-d8b44f550b2d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:32.281811 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-693aebb2-7e95-407c-b16e-d8b44f550b2d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:32.283951 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-693aebb2-7e95-407c-b16e-d8b44f550b2d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:32.285216 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-693aebb2-7e95-407c-b16e-d8b44f550b2d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1745 microversion: 2.20 time: 0.161082 Aug 01 14:22:32.285776 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 129/265] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:32 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:32.288627 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7210b1f5-6fff-48f9-896f-0012bdcdd553 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:32.289245 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7210b1f5-6fff-48f9-896f-0012bdcdd553 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:32.295416 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7210b1f5-6fff-48f9-896f-0012bdcdd553 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:32.295899 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7210b1f5-6fff-48f9-896f-0012bdcdd553 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:32.296669 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7210b1f5-6fff-48f9-896f-0012bdcdd553 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:32.297106 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7210b1f5-6fff-48f9-896f-0012bdcdd553 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:32.317619 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=100 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:32.431448 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7210b1f5-6fff-48f9-896f-0012bdcdd553 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:32.439535 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7210b1f5-6fff-48f9-896f-0012bdcdd553 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.155166 Aug 01 14:22:32.440106 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 137/266] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:32 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:32.446014 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e6f5a352-c715-4193-a9e8-8fc7e81837d8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:32.446619 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e6f5a352-c715-4193-a9e8-8fc7e81837d8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:32.452831 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e6f5a352-c715-4193-a9e8-8fc7e81837d8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:32.453265 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e6f5a352-c715-4193-a9e8-8fc7e81837d8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:32.454634 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e6f5a352-c715-4193-a9e8-8fc7e81837d8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:32.455062 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e6f5a352-c715-4193-a9e8-8fc7e81837d8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:32.473311 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:32.521089 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-74a8896c-dd17-4f8d-b956-edc559dca763 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:32.521751 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-74a8896c-dd17-4f8d-b956-edc559dca763 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:32.527693 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-74a8896c-dd17-4f8d-b956-edc559dca763 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:32.528144 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-74a8896c-dd17-4f8d-b956-edc559dca763 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:32.528915 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-74a8896c-dd17-4f8d-b956-edc559dca763 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:32.529349 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-74a8896c-dd17-4f8d-b956-edc559dca763 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:32.588545 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e6f5a352-c715-4193-a9e8-8fc7e81837d8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:32.595614 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-74a8896c-dd17-4f8d-b956-edc559dca763 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:32.596729 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e6f5a352-c715-4193-a9e8-8fc7e81837d8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1314 microversion: 2.1 time: 0.154408 Aug 01 14:22:32.597382 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 130/267] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:32 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:32.603301 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-74a8896c-dd17-4f8d-b956-edc559dca763 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 200 len: 1244 microversion: 2.1 time: 0.086673 Aug 01 14:22:32.603898 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 138/268] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:32 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:33.308196 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d8cf7f9d-0a32-45fa-8683-9daab48608ff tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:33.308801 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d8cf7f9d-0a32-45fa-8683-9daab48608ff tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:33.316174 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d8cf7f9d-0a32-45fa-8683-9daab48608ff tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:33.316629 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d8cf7f9d-0a32-45fa-8683-9daab48608ff tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:33.317394 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d8cf7f9d-0a32-45fa-8683-9daab48608ff tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:33.317833 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d8cf7f9d-0a32-45fa-8683-9daab48608ff tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:33.457513 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d8cf7f9d-0a32-45fa-8683-9daab48608ff tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:33.462919 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5b007008-37ec-4026-aca5-b8699d8a924a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:33.463565 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5b007008-37ec-4026-aca5-b8699d8a924a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:33.469482 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d8cf7f9d-0a32-45fa-8683-9daab48608ff tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:33.472025 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5b007008-37ec-4026-aca5-b8699d8a924a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:33.472160 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d8cf7f9d-0a32-45fa-8683-9daab48608ff tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:33.472485 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5b007008-37ec-4026-aca5-b8699d8a924a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:33.473490 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5b007008-37ec-4026-aca5-b8699d8a924a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:33.474026 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5b007008-37ec-4026-aca5-b8699d8a924a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:33.474480 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d8cf7f9d-0a32-45fa-8683-9daab48608ff tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1745 microversion: 2.20 time: 0.169698 Aug 01 14:22:33.488088 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 131/269] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:33 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1745 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:33.617390 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-dd8140be-e357-46d7-809d-affb6f199461 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:33.618765 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-dd8140be-e357-46d7-809d-affb6f199461 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:33.629250 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dd8140be-e357-46d7-809d-affb6f199461 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:33.629517 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5b007008-37ec-4026-aca5-b8699d8a924a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:33.629700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dd8140be-e357-46d7-809d-affb6f199461 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:33.630476 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dd8140be-e357-46d7-809d-affb6f199461 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:33.630908 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dd8140be-e357-46d7-809d-affb6f199461 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:33.637685 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5b007008-37ec-4026-aca5-b8699d8a924a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.179891 Aug 01 14:22:33.651564 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 139/270] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:33 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:33.663438 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a27cf1a4-fe4d-403f-95db-36602216846c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:33.664181 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a27cf1a4-fe4d-403f-95db-36602216846c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:33.670834 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a27cf1a4-fe4d-403f-95db-36602216846c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:33.671413 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a27cf1a4-fe4d-403f-95db-36602216846c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:33.672366 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a27cf1a4-fe4d-403f-95db-36602216846c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:33.673592 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a27cf1a4-fe4d-403f-95db-36602216846c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:33.739140 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a27cf1a4-fe4d-403f-95db-36602216846c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:33.746884 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a27cf1a4-fe4d-403f-95db-36602216846c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 200 len: 1236 microversion: 2.1 time: 0.094089 Aug 01 14:22:33.747766 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 140/271] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:33 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 1236 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:33.781800 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-dd8140be-e357-46d7-809d-affb6f199461 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:33.790174 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-dd8140be-e357-46d7-809d-affb6f199461 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1314 microversion: 2.1 time: 0.176699 Aug 01 14:22:33.790751 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 132/272] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:33 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:34.498579 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d8b22895-55eb-435b-a255-b47bbb954ecf tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:34.499188 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d8b22895-55eb-435b-a255-b47bbb954ecf tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:34.506057 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d8b22895-55eb-435b-a255-b47bbb954ecf tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:34.506499 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d8b22895-55eb-435b-a255-b47bbb954ecf tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:34.507261 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d8b22895-55eb-435b-a255-b47bbb954ecf tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:34.507733 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d8b22895-55eb-435b-a255-b47bbb954ecf tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:34.650842 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d8b22895-55eb-435b-a255-b47bbb954ecf tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:34.657979 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ff8dfa19-e579-44f5-b792-22aec79389fa tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:34.658678 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ff8dfa19-e579-44f5-b792-22aec79389fa tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:34.660568 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d8b22895-55eb-435b-a255-b47bbb954ecf tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:34.662423 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d8b22895-55eb-435b-a255-b47bbb954ecf tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:34.663604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d8b22895-55eb-435b-a255-b47bbb954ecf tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1745 microversion: 2.20 time: 0.169210 Aug 01 14:22:34.664172 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 141/273] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:34 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:34.665603 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ff8dfa19-e579-44f5-b792-22aec79389fa tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:34.667215 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ff8dfa19-e579-44f5-b792-22aec79389fa tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:34.668151 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ff8dfa19-e579-44f5-b792-22aec79389fa tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:34.668704 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ff8dfa19-e579-44f5-b792-22aec79389fa tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:34.769239 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3202e726-fbd2-424a-913a-984ac051da35 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:34.769843 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3202e726-fbd2-424a-913a-984ac051da35 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:34.776047 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3202e726-fbd2-424a-913a-984ac051da35 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:34.776496 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3202e726-fbd2-424a-913a-984ac051da35 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:34.777263 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3202e726-fbd2-424a-913a-984ac051da35 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:34.777771 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3202e726-fbd2-424a-913a-984ac051da35 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:34.810141 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ff8dfa19-e579-44f5-b792-22aec79389fa tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:34.819534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ff8dfa19-e579-44f5-b792-22aec79389fa tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.165246 Aug 01 14:22:34.820397 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 133/274] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:34 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:34.825425 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f5394e1f-17ac-4786-b720-7f8479620185 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:34.826508 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f5394e1f-17ac-4786-b720-7f8479620185 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:34.834179 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f5394e1f-17ac-4786-b720-7f8479620185 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:34.834626 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f5394e1f-17ac-4786-b720-7f8479620185 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:34.835580 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f5394e1f-17ac-4786-b720-7f8479620185 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:34.836023 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f5394e1f-17ac-4786-b720-7f8479620185 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:34.859402 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3202e726-fbd2-424a-913a-984ac051da35 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:34.868822 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3202e726-fbd2-424a-913a-984ac051da35 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 200 len: 1292 microversion: 2.1 time: 0.103943 Aug 01 14:22:34.869696 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 142/275] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:34 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 1292 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:34.964424 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-b4a9a49b-ccf6-452e-a9bd-8043c484d2f3 req-b0800dce-59b8-432f-a9e5-7c1ecce67434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76deb7da-88aa-4c26-b55d-fd6432d1e680", "name": "network-vif-plugged", "status": "completed", "tag": "e905a309-fe29-4762-880d-f6eb375da04f"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:34.983700 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-b4a9a49b-ccf6-452e-a9bd-8043c484d2f3 req-b0800dce-59b8-432f-a9e5-7c1ecce67434 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:34.984277 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-b4a9a49b-ccf6-452e-a9bd-8043c484d2f3 req-b0800dce-59b8-432f-a9e5-7c1ecce67434 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:34.989374 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f5394e1f-17ac-4786-b720-7f8479620185 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:35.001224 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-b4a9a49b-ccf6-452e-a9bd-8043c484d2f3 req-b0800dce-59b8-432f-a9e5-7c1ecce67434 service nova] Creating event network-vif-plugged:e905a309-fe29-4762-880d-f6eb375da04f for instance 76deb7da-88aa-4c26-b55d-fd6432d1e680 on hv-cinder-84599 Aug 01 14:22:35.008321 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f5394e1f-17ac-4786-b720-7f8479620185 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1314 microversion: 2.1 time: 0.186559 Aug 01 14:22:35.008890 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-b4a9a49b-ccf6-452e-a9bd-8043c484d2f3 req-b0800dce-59b8-432f-a9e5-7c1ecce67434 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048267 Aug 01 14:22:35.009498 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 134/276] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:34 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:35.009941 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 143/277] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:22:35.693584 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0bdbabdf-42e7-40d0-a08a-6ddf57726637 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:35.693985 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0bdbabdf-42e7-40d0-a08a-6ddf57726637 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:35.708052 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0bdbabdf-42e7-40d0-a08a-6ddf57726637 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:35.708300 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0bdbabdf-42e7-40d0-a08a-6ddf57726637 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:35.709190 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0bdbabdf-42e7-40d0-a08a-6ddf57726637 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:35.709957 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0bdbabdf-42e7-40d0-a08a-6ddf57726637 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:35.853436 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-92d76578-94bf-45d8-a400-bb7fa32e1eea tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:35.861002 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-92d76578-94bf-45d8-a400-bb7fa32e1eea tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:35.879312 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-92d76578-94bf-45d8-a400-bb7fa32e1eea tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:35.879918 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-92d76578-94bf-45d8-a400-bb7fa32e1eea tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:35.880916 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-92d76578-94bf-45d8-a400-bb7fa32e1eea tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:35.881386 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-92d76578-94bf-45d8-a400-bb7fa32e1eea tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:35.903409 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0bdbabdf-42e7-40d0-a08a-6ddf57726637 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:35.913117 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0bdbabdf-42e7-40d0-a08a-6ddf57726637 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:35.914671 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0bdbabdf-42e7-40d0-a08a-6ddf57726637 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:35.915901 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0bdbabdf-42e7-40d0-a08a-6ddf57726637 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1740 microversion: 2.20 time: 0.227540 Aug 01 14:22:35.918468 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 135/278] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:35 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1740 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:35.927196 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-77dfa719-8aec-411b-aabb-4902962c6beb tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:35.932891 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-77dfa719-8aec-411b-aabb-4902962c6beb tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:35.941770 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-77dfa719-8aec-411b-aabb-4902962c6beb tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:35.942494 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-77dfa719-8aec-411b-aabb-4902962c6beb tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:35.943518 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-77dfa719-8aec-411b-aabb-4902962c6beb tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:35.943928 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-77dfa719-8aec-411b-aabb-4902962c6beb tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:36.128519 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-77dfa719-8aec-411b-aabb-4902962c6beb tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:36.137182 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-77dfa719-8aec-411b-aabb-4902962c6beb tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 200 len: 1366 microversion: 2.1 time: 0.215309 Aug 01 14:22:36.138531 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 136/279] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:35 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:36.152846 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-92d76578-94bf-45d8-a400-bb7fa32e1eea tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:36.156419 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-cb95f352-8d4a-4a6e-bae3-92b9db6d793f tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:36.157464 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-cb95f352-8d4a-4a6e-bae3-92b9db6d793f tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:36.167540 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-92d76578-94bf-45d8-a400-bb7fa32e1eea tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.323891 Aug 01 14:22:36.171138 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cb95f352-8d4a-4a6e-bae3-92b9db6d793f tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:36.171844 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cb95f352-8d4a-4a6e-bae3-92b9db6d793f tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:36.173347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 144/280] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:35 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:36.173533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cb95f352-8d4a-4a6e-bae3-92b9db6d793f tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:36.174141 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cb95f352-8d4a-4a6e-bae3-92b9db6d793f tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:36.346386 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-cb95f352-8d4a-4a6e-bae3-92b9db6d793f tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:36.355886 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-cb95f352-8d4a-4a6e-bae3-92b9db6d793f tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1314 microversion: 2.1 time: 0.215709 Aug 01 14:22:36.356610 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 137/281] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:36 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:36.887114 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-98ffd48c-6ba6-41b3-a1c7-ab551fb70476 req-5677bdf8-ad07-4438-b82e-89d707ff3e33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af4ff82b-d3d6-42c8-aeee-186eacd74c9d", "tag": "67dc1e44-3667-466f-9a2c-ce4f193e8d0d"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:36.902480 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-98ffd48c-6ba6-41b3-a1c7-ab551fb70476 req-5677bdf8-ad07-4438-b82e-89d707ff3e33 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:36.902919 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-98ffd48c-6ba6-41b3-a1c7-ab551fb70476 req-5677bdf8-ad07-4438-b82e-89d707ff3e33 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:36.924913 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-98ffd48c-6ba6-41b3-a1c7-ab551fb70476 req-5677bdf8-ad07-4438-b82e-89d707ff3e33 service nova] Creating event network-changed:67dc1e44-3667-466f-9a2c-ce4f193e8d0d for instance af4ff82b-d3d6-42c8-aeee-186eacd74c9d on hv-cinder-84599 Aug 01 14:22:36.929838 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-98ffd48c-6ba6-41b3-a1c7-ab551fb70476 req-5677bdf8-ad07-4438-b82e-89d707ff3e33 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050206 Aug 01 14:22:36.930444 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 145/282] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:22:36.941493 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ae2fc5f3-5c46-4d16-998a-fc4c73888857 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:36.942249 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ae2fc5f3-5c46-4d16-998a-fc4c73888857 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:36.948982 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ae2fc5f3-5c46-4d16-998a-fc4c73888857 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:36.949511 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ae2fc5f3-5c46-4d16-998a-fc4c73888857 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:36.950336 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ae2fc5f3-5c46-4d16-998a-fc4c73888857 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:36.950828 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ae2fc5f3-5c46-4d16-998a-fc4c73888857 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:37.042675 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-36841479-f726-48c8-9170-c94edcc0d719 req-be0efb05-037b-48f1-8987-7944d5313eea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15f45ea0-8c33-457c-88d7-e027e4a9109e", "name": "network-vif-plugged", "status": "completed", "tag": "726cf288-ee4a-4a3b-8fd7-a4a8bcff4423"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:37.070178 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-36841479-f726-48c8-9170-c94edcc0d719 req-be0efb05-037b-48f1-8987-7944d5313eea service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:37.070631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-36841479-f726-48c8-9170-c94edcc0d719 req-be0efb05-037b-48f1-8987-7944d5313eea service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:37.094517 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-36841479-f726-48c8-9170-c94edcc0d719 req-be0efb05-037b-48f1-8987-7944d5313eea service nova] Creating event network-vif-plugged:726cf288-ee4a-4a3b-8fd7-a4a8bcff4423 for instance 15f45ea0-8c33-457c-88d7-e027e4a9109e on hv-cinder-84599 Aug 01 14:22:37.104474 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-36841479-f726-48c8-9170-c94edcc0d719 req-be0efb05-037b-48f1-8987-7944d5313eea service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066013 Aug 01 14:22:37.106977 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 146/283] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:22:37.141078 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ae2fc5f3-5c46-4d16-998a-fc4c73888857 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:37.153132 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ae2fc5f3-5c46-4d16-998a-fc4c73888857 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:37.154958 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ae2fc5f3-5c46-4d16-998a-fc4c73888857 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:37.156419 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ae2fc5f3-5c46-4d16-998a-fc4c73888857 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1740 microversion: 2.20 time: 0.219256 Aug 01 14:22:37.157601 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 138/284] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:36 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1740 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:37.164722 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e4a4406e-da9f-4966-a9cc-7b415a25b06d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:37.165850 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e4a4406e-da9f-4966-a9cc-7b415a25b06d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:37.194037 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e4a4406e-da9f-4966-a9cc-7b415a25b06d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:37.194490 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e4a4406e-da9f-4966-a9cc-7b415a25b06d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:37.195652 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-817c22b9-5780-48e4-8919-00b113016fc8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:37.196436 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-817c22b9-5780-48e4-8919-00b113016fc8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:37.196561 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e4a4406e-da9f-4966-a9cc-7b415a25b06d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:37.196982 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e4a4406e-da9f-4966-a9cc-7b415a25b06d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:37.217922 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-817c22b9-5780-48e4-8919-00b113016fc8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:37.218682 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-817c22b9-5780-48e4-8919-00b113016fc8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:37.219705 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-817c22b9-5780-48e4-8919-00b113016fc8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:37.221912 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-817c22b9-5780-48e4-8919-00b113016fc8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:37.420542 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-817c22b9-5780-48e4-8919-00b113016fc8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:37.430362 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-817c22b9-5780-48e4-8919-00b113016fc8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.240019 Aug 01 14:22:37.431250 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 139/285] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:37 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:37.436416 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4342a4aa-2fba-4d50-bd56-d2603feece2c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:37.437023 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4342a4aa-2fba-4d50-bd56-d2603feece2c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:37.444521 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4342a4aa-2fba-4d50-bd56-d2603feece2c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:37.446971 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4342a4aa-2fba-4d50-bd56-d2603feece2c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:37.446971 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4342a4aa-2fba-4d50-bd56-d2603feece2c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:37.446971 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4342a4aa-2fba-4d50-bd56-d2603feece2c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:37.629249 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4342a4aa-2fba-4d50-bd56-d2603feece2c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:37.638873 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4342a4aa-2fba-4d50-bd56-d2603feece2c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1314 microversion: 2.1 time: 0.206125 Aug 01 14:22:37.677095 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 140/286] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:37 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:37.682412 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4f5b6c45-22b7-4ac8-aac6-ccaf2b0e4bd5 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:37.682920 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4f5b6c45-22b7-4ac8-aac6-ccaf2b0e4bd5 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:37.693951 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4f5b6c45-22b7-4ac8-aac6-ccaf2b0e4bd5 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:37.694402 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4f5b6c45-22b7-4ac8-aac6-ccaf2b0e4bd5 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:37.695376 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4f5b6c45-22b7-4ac8-aac6-ccaf2b0e4bd5 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:37.695856 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4f5b6c45-22b7-4ac8-aac6-ccaf2b0e4bd5 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:37.725667 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4f5b6c45-22b7-4ac8-aac6-ccaf2b0e4bd5 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Going to try to terminate instance {{(pid=118132) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:22:37.740832 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e4a4406e-da9f-4966-a9cc-7b415a25b06d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:37.762570 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e4a4406e-da9f-4966-a9cc-7b415a25b06d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 200 len: 1366 microversion: 2.1 time: 0.602887 Aug 01 14:22:37.763178 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 147/287] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:37 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 1366 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:37.834356 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4f5b6c45-22b7-4ac8-aac6-ccaf2b0e4bd5 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4" status: 204 len: 0 microversion: 2.1 time: 0.155679 Aug 01 14:22:37.835350 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 141/288] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Aug 1 14:22:37 2022] DELETE /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:22:37.847786 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-da1515c1-fbe7-4c57-a6bb-ba9c5a7c4fc0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:37.849305 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-da1515c1-fbe7-4c57-a6bb-ba9c5a7c4fc0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:37.859296 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-da1515c1-fbe7-4c57-a6bb-ba9c5a7c4fc0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:37.859650 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-da1515c1-fbe7-4c57-a6bb-ba9c5a7c4fc0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:37.860965 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-da1515c1-fbe7-4c57-a6bb-ba9c5a7c4fc0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:37.861403 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-da1515c1-fbe7-4c57-a6bb-ba9c5a7c4fc0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:38.048778 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-da1515c1-fbe7-4c57-a6bb-ba9c5a7c4fc0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:38.058377 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-da1515c1-fbe7-4c57-a6bb-ba9c5a7c4fc0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4" status: 200 len: 1512 microversion: 2.1 time: 0.218011 Aug 01 14:22:38.058966 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 148/289] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:37 2022] GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 => generated 1512 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:38.194133 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-dd34d3e3-a070-4360-81e0-92dc68708026 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:38.194881 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-dd34d3e3-a070-4360-81e0-92dc68708026 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:38.209587 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dd34d3e3-a070-4360-81e0-92dc68708026 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:38.209587 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dd34d3e3-a070-4360-81e0-92dc68708026 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:38.210493 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dd34d3e3-a070-4360-81e0-92dc68708026 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:38.216100 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dd34d3e3-a070-4360-81e0-92dc68708026 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:38.420926 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-dd34d3e3-a070-4360-81e0-92dc68708026 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:38.431893 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-dd34d3e3-a070-4360-81e0-92dc68708026 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:38.433972 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-dd34d3e3-a070-4360-81e0-92dc68708026 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:38.435881 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-dd34d3e3-a070-4360-81e0-92dc68708026 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1740 microversion: 2.20 time: 0.247146 Aug 01 14:22:38.436961 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 142/290] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:38 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1740 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:38.457066 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9230d4af-812e-4b1e-99bf-2083d6221465 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:38.458010 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9230d4af-812e-4b1e-99bf-2083d6221465 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:38.471653 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9230d4af-812e-4b1e-99bf-2083d6221465 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:38.472415 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9230d4af-812e-4b1e-99bf-2083d6221465 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:38.473414 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9230d4af-812e-4b1e-99bf-2083d6221465 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:38.474146 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9230d4af-812e-4b1e-99bf-2083d6221465 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:38.672438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-87ff4c59-3979-4562-93aa-b66ceeedb752 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:38.676477 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-87ff4c59-3979-4562-93aa-b66ceeedb752 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:38.683102 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9230d4af-812e-4b1e-99bf-2083d6221465 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:38.696551 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9230d4af-812e-4b1e-99bf-2083d6221465 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.244405 Aug 01 14:22:38.704403 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-87ff4c59-3979-4562-93aa-b66ceeedb752 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:38.706635 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 149/291] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:38 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:38.707267 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-87ff4c59-3979-4562-93aa-b66ceeedb752 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:38.708216 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-87ff4c59-3979-4562-93aa-b66ceeedb752 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:38.708761 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-87ff4c59-3979-4562-93aa-b66ceeedb752 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:38.792972 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-1efd806d-7b1b-4056-9be5-3de7ac4dcd13 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:38.794061 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1efd806d-7b1b-4056-9be5-3de7ac4dcd13 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:38.803820 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1efd806d-7b1b-4056-9be5-3de7ac4dcd13 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:38.804582 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1efd806d-7b1b-4056-9be5-3de7ac4dcd13 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:38.805546 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1efd806d-7b1b-4056-9be5-3de7ac4dcd13 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:38.806015 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1efd806d-7b1b-4056-9be5-3de7ac4dcd13 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:38.921289 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-87ff4c59-3979-4562-93aa-b66ceeedb752 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:38.932568 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-87ff4c59-3979-4562-93aa-b66ceeedb752 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1314 microversion: 2.1 time: 0.264250 Aug 01 14:22:38.933443 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 143/292] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:38 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:38.990506 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1efd806d-7b1b-4056-9be5-3de7ac4dcd13 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:38.999511 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-1efd806d-7b1b-4056-9be5-3de7ac4dcd13 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 200 len: 1366 microversion: 2.1 time: 0.217160 Aug 01 14:22:39.001542 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 150/293] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:38 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:39.085174 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-103afb85-2e03-42ab-b584-ec1cebf7c78f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:39.086620 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-103afb85-2e03-42ab-b584-ec1cebf7c78f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:39.098115 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-103afb85-2e03-42ab-b584-ec1cebf7c78f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:39.098771 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-103afb85-2e03-42ab-b584-ec1cebf7c78f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:39.099582 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-103afb85-2e03-42ab-b584-ec1cebf7c78f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:39.100018 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-103afb85-2e03-42ab-b584-ec1cebf7c78f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:39.275418 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-103afb85-2e03-42ab-b584-ec1cebf7c78f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:39.284149 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-103afb85-2e03-42ab-b584-ec1cebf7c78f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4" status: 200 len: 1512 microversion: 2.1 time: 0.202739 Aug 01 14:22:39.284992 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 144/294] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:39 2022] GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 => generated 1512 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:39.464531 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-98c8a5ae-d2c3-40ef-a0a8-d7bfa5ee59e7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:39.465780 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-98c8a5ae-d2c3-40ef-a0a8-d7bfa5ee59e7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:39.473757 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-98c8a5ae-d2c3-40ef-a0a8-d7bfa5ee59e7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:39.474326 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-98c8a5ae-d2c3-40ef-a0a8-d7bfa5ee59e7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:39.475717 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-98c8a5ae-d2c3-40ef-a0a8-d7bfa5ee59e7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:39.482263 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-98c8a5ae-d2c3-40ef-a0a8-d7bfa5ee59e7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:39.652713 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-98c8a5ae-d2c3-40ef-a0a8-d7bfa5ee59e7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:39.666331 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-98c8a5ae-d2c3-40ef-a0a8-d7bfa5ee59e7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:39.670515 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-98c8a5ae-d2c3-40ef-a0a8-d7bfa5ee59e7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:39.672051 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-98c8a5ae-d2c3-40ef-a0a8-d7bfa5ee59e7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1740 microversion: 2.20 time: 0.211992 Aug 01 14:22:39.676384 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 151/295] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:39 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1740 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:22:39.730681 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9e112977-b339-4a93-84dc-195985a92f57 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:39.731276 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9e112977-b339-4a93-84dc-195985a92f57 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:39.738024 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9e112977-b339-4a93-84dc-195985a92f57 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:39.738469 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9e112977-b339-4a93-84dc-195985a92f57 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:39.739629 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9e112977-b339-4a93-84dc-195985a92f57 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:39.740072 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9e112977-b339-4a93-84dc-195985a92f57 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:39.761014 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:39.922238 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9e112977-b339-4a93-84dc-195985a92f57 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:39.933142 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9e112977-b339-4a93-84dc-195985a92f57 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.206621 Aug 01 14:22:39.934095 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 145/296] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:39 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:39.957862 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-4422b93e-3db5-4994-a35c-323766372fbd tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:39.958476 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-4422b93e-3db5-4994-a35c-323766372fbd tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:39.960965 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:39.966754 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4422b93e-3db5-4994-a35c-323766372fbd tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:39.967200 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4422b93e-3db5-4994-a35c-323766372fbd tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:39.968007 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4422b93e-3db5-4994-a35c-323766372fbd tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:39.968437 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4422b93e-3db5-4994-a35c-323766372fbd tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:40.023725 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3574b0ff-f7c4-4610-bea9-0b0ae934e68f tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:40.024588 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3574b0ff-f7c4-4610-bea9-0b0ae934e68f tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:40.031059 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3574b0ff-f7c4-4610-bea9-0b0ae934e68f tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:40.031782 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3574b0ff-f7c4-4610-bea9-0b0ae934e68f tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:40.032778 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3574b0ff-f7c4-4610-bea9-0b0ae934e68f tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:40.033361 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3574b0ff-f7c4-4610-bea9-0b0ae934e68f tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:40.190199 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4422b93e-3db5-4994-a35c-323766372fbd tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:40.199817 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3574b0ff-f7c4-4610-bea9-0b0ae934e68f tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:40.209054 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-4422b93e-3db5-4994-a35c-323766372fbd tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1314 microversion: 2.1 time: 0.255481 Aug 01 14:22:40.209827 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 152/297] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:39 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:40.211357 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3574b0ff-f7c4-4610-bea9-0b0ae934e68f tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 200 len: 1366 microversion: 2.1 time: 0.192400 Aug 01 14:22:40.212054 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 146/298] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:40 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:40.309063 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a4571061-66f2-4fc1-90e0-242169ac9af9 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:40.312077 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a4571061-66f2-4fc1-90e0-242169ac9af9 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:40.320066 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a4571061-66f2-4fc1-90e0-242169ac9af9 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:40.320514 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a4571061-66f2-4fc1-90e0-242169ac9af9 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:40.321388 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a4571061-66f2-4fc1-90e0-242169ac9af9 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:40.321885 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a4571061-66f2-4fc1-90e0-242169ac9af9 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:40.468634 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a4571061-66f2-4fc1-90e0-242169ac9af9 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:40.477205 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a4571061-66f2-4fc1-90e0-242169ac9af9 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4" status: 200 len: 1512 microversion: 2.1 time: 0.174433 Aug 01 14:22:40.477885 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 153/299] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:40 2022] GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 => generated 1512 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:40.698736 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e6c17ace-f455-4963-a402-ad8fcbb40975 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:40.700811 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e6c17ace-f455-4963-a402-ad8fcbb40975 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:40.704691 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:40.709453 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e6c17ace-f455-4963-a402-ad8fcbb40975 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:40.710029 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e6c17ace-f455-4963-a402-ad8fcbb40975 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:40.711086 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e6c17ace-f455-4963-a402-ad8fcbb40975 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:40.711839 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e6c17ace-f455-4963-a402-ad8fcbb40975 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:40.869491 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e6c17ace-f455-4963-a402-ad8fcbb40975 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:40.879004 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e6c17ace-f455-4963-a402-ad8fcbb40975 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:40.882670 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e6c17ace-f455-4963-a402-ad8fcbb40975 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:40.882670 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e6c17ace-f455-4963-a402-ad8fcbb40975 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1740 microversion: 2.20 time: 0.188078 Aug 01 14:22:40.882670 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 147/300] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:40 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:40.955117 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-67f35278-ff0d-44a8-9c09-865d0811476e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:40.955785 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-67f35278-ff0d-44a8-9c09-865d0811476e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:40.962865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-67f35278-ff0d-44a8-9c09-865d0811476e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:40.964432 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-67f35278-ff0d-44a8-9c09-865d0811476e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:40.965440 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-67f35278-ff0d-44a8-9c09-865d0811476e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:40.966049 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-67f35278-ff0d-44a8-9c09-865d0811476e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:41.121400 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-67f35278-ff0d-44a8-9c09-865d0811476e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:41.130293 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-67f35278-ff0d-44a8-9c09-865d0811476e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.179049 Aug 01 14:22:41.144075 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 154/301] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:40 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:41.231238 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-fbb21981-8c4e-49d8-9aff-2208d0adb176 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:41.232788 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-fbb21981-8c4e-49d8-9aff-2208d0adb176 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:41.234188 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6fa27745-b04f-44d4-9b1b-48b86e03c3b6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:41.234933 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-6fa27745-b04f-44d4-9b1b-48b86e03c3b6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:41.241475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fbb21981-8c4e-49d8-9aff-2208d0adb176 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:41.242587 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fbb21981-8c4e-49d8-9aff-2208d0adb176 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:41.242823 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6fa27745-b04f-44d4-9b1b-48b86e03c3b6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:41.243367 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6fa27745-b04f-44d4-9b1b-48b86e03c3b6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:41.243993 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fbb21981-8c4e-49d8-9aff-2208d0adb176 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:41.244596 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fbb21981-8c4e-49d8-9aff-2208d0adb176 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:41.244952 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6fa27745-b04f-44d4-9b1b-48b86e03c3b6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:41.245465 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6fa27745-b04f-44d4-9b1b-48b86e03c3b6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:41.345006 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:41.416187 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-fbb21981-8c4e-49d8-9aff-2208d0adb176 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:41.427848 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-fbb21981-8c4e-49d8-9aff-2208d0adb176 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1314 microversion: 2.1 time: 0.198939 Aug 01 14:22:41.428950 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 148/302] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:41 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:41.433272 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6fa27745-b04f-44d4-9b1b-48b86e03c3b6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:41.442103 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6fa27745-b04f-44d4-9b1b-48b86e03c3b6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 200 len: 1366 microversion: 2.1 time: 0.212492 Aug 01 14:22:41.442807 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 155/303] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:41 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:41.498421 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-fd05c23f-c266-4420-aea6-d28e8a35f5f0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:41.499021 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-fd05c23f-c266-4420-aea6-d28e8a35f5f0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:41.506600 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fd05c23f-c266-4420-aea6-d28e8a35f5f0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:41.507307 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fd05c23f-c266-4420-aea6-d28e8a35f5f0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:41.508007 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fd05c23f-c266-4420-aea6-d28e8a35f5f0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:41.508682 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fd05c23f-c266-4420-aea6-d28e8a35f5f0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:41.660329 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-fd05c23f-c266-4420-aea6-d28e8a35f5f0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:41.667782 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-fd05c23f-c266-4420-aea6-d28e8a35f5f0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4" status: 200 len: 1512 microversion: 2.1 time: 0.173248 Aug 01 14:22:41.679952 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 149/304] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:41 2022] GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 => generated 1512 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:41.906263 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d50e6779-90d3-4007-b5bd-b2a73ede7b84 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:41.907086 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d50e6779-90d3-4007-b5bd-b2a73ede7b84 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:41.913143 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=12 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:41.915638 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d50e6779-90d3-4007-b5bd-b2a73ede7b84 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:41.916177 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d50e6779-90d3-4007-b5bd-b2a73ede7b84 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:41.917320 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d50e6779-90d3-4007-b5bd-b2a73ede7b84 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:41.917883 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d50e6779-90d3-4007-b5bd-b2a73ede7b84 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:41.936068 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=100 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:42.078455 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d50e6779-90d3-4007-b5bd-b2a73ede7b84 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:42.087759 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d50e6779-90d3-4007-b5bd-b2a73ede7b84 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:42.089626 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d50e6779-90d3-4007-b5bd-b2a73ede7b84 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:42.091076 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d50e6779-90d3-4007-b5bd-b2a73ede7b84 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1740 microversion: 2.20 time: 0.189021 Aug 01 14:22:42.107179 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 156/305] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:41 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:22:42.153607 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4d6c8086-de82-4fdb-8380-efe9c27b7d8e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:42.154300 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4d6c8086-de82-4fdb-8380-efe9c27b7d8e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:42.161364 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4d6c8086-de82-4fdb-8380-efe9c27b7d8e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:42.161893 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4d6c8086-de82-4fdb-8380-efe9c27b7d8e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:42.162961 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4d6c8086-de82-4fdb-8380-efe9c27b7d8e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:42.163487 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4d6c8086-de82-4fdb-8380-efe9c27b7d8e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:42.346660 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4d6c8086-de82-4fdb-8380-efe9c27b7d8e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:42.354908 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4d6c8086-de82-4fdb-8380-efe9c27b7d8e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.207590 Aug 01 14:22:42.355504 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 150/306] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:42 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:42.457382 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e3fa56d7-24a0-497f-a703-3027745fb22b tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:42.458229 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e3fa56d7-24a0-497f-a703-3027745fb22b tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:42.463988 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9127b671-e744-4427-a820-0afdeff90f4c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:42.465144 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9127b671-e744-4427-a820-0afdeff90f4c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:42.465280 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e3fa56d7-24a0-497f-a703-3027745fb22b tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:42.468745 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e3fa56d7-24a0-497f-a703-3027745fb22b tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:42.470409 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e3fa56d7-24a0-497f-a703-3027745fb22b tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:42.470858 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e3fa56d7-24a0-497f-a703-3027745fb22b tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:42.474256 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9127b671-e744-4427-a820-0afdeff90f4c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:42.475685 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9127b671-e744-4427-a820-0afdeff90f4c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:42.476711 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9127b671-e744-4427-a820-0afdeff90f4c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:42.477696 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9127b671-e744-4427-a820-0afdeff90f4c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:42.642653 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e3fa56d7-24a0-497f-a703-3027745fb22b tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:42.654600 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e3fa56d7-24a0-497f-a703-3027745fb22b tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1314 microversion: 2.1 time: 0.201992 Aug 01 14:22:42.655560 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 157/307] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:42 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:42.665616 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9127b671-e744-4427-a820-0afdeff90f4c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:42.674544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9127b671-e744-4427-a820-0afdeff90f4c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 200 len: 1366 microversion: 2.1 time: 0.214531 Aug 01 14:22:42.688163 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 151/308] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:42 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:42.693047 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7e5ae173-0533-41fc-961d-6e6a29ba41cf tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:42.693853 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7e5ae173-0533-41fc-961d-6e6a29ba41cf tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:42.704180 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7e5ae173-0533-41fc-961d-6e6a29ba41cf tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:42.704180 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7e5ae173-0533-41fc-961d-6e6a29ba41cf tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:42.704180 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7e5ae173-0533-41fc-961d-6e6a29ba41cf tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:42.704601 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7e5ae173-0533-41fc-961d-6e6a29ba41cf tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:42.867810 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7e5ae173-0533-41fc-961d-6e6a29ba41cf tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:42.876753 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7e5ae173-0533-41fc-961d-6e6a29ba41cf tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4" status: 200 len: 1512 microversion: 2.1 time: 0.188792 Aug 01 14:22:42.877561 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 158/309] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:42 2022] GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 => generated 1512 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:43.116383 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-da77b1fc-5453-4e05-9048-bc3833206972 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:43.116989 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-da77b1fc-5453-4e05-9048-bc3833206972 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:43.134911 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-da77b1fc-5453-4e05-9048-bc3833206972 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:43.135387 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-da77b1fc-5453-4e05-9048-bc3833206972 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:43.136306 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-da77b1fc-5453-4e05-9048-bc3833206972 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:43.136747 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-da77b1fc-5453-4e05-9048-bc3833206972 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:43.329957 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-da77b1fc-5453-4e05-9048-bc3833206972 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:43.339726 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-da77b1fc-5453-4e05-9048-bc3833206972 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:43.341252 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-da77b1fc-5453-4e05-9048-bc3833206972 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:43.342443 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-da77b1fc-5453-4e05-9048-bc3833206972 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1740 microversion: 2.20 time: 0.229999 Aug 01 14:22:43.350626 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 152/310] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:43 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1740 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:43.376745 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6c9af838-3a89-4845-91d7-99197b830a5f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:43.377990 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-6c9af838-3a89-4845-91d7-99197b830a5f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:43.387556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6c9af838-3a89-4845-91d7-99197b830a5f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:43.388300 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6c9af838-3a89-4845-91d7-99197b830a5f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:43.389231 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6c9af838-3a89-4845-91d7-99197b830a5f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:43.389818 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6c9af838-3a89-4845-91d7-99197b830a5f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:43.536766 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6c9af838-3a89-4845-91d7-99197b830a5f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:43.545223 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6c9af838-3a89-4845-91d7-99197b830a5f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.172899 Aug 01 14:22:43.546364 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 159/311] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:43 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:43.696694 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9647745e-a1a7-42f0-a9d9-d0cbfa4ab1e0 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:43.697858 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9647745e-a1a7-42f0-a9d9-d0cbfa4ab1e0 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:43.705805 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9647745e-a1a7-42f0-a9d9-d0cbfa4ab1e0 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:43.706550 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9647745e-a1a7-42f0-a9d9-d0cbfa4ab1e0 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:43.707526 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9647745e-a1a7-42f0-a9d9-d0cbfa4ab1e0 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:43.708915 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9647745e-a1a7-42f0-a9d9-d0cbfa4ab1e0 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:43.754171 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-981f5ff9-0cbd-4056-8ee5-ac3258eb8872 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:43.754893 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-981f5ff9-0cbd-4056-8ee5-ac3258eb8872 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:43.764497 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-981f5ff9-0cbd-4056-8ee5-ac3258eb8872 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:43.765053 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-981f5ff9-0cbd-4056-8ee5-ac3258eb8872 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:43.765942 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-981f5ff9-0cbd-4056-8ee5-ac3258eb8872 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:43.766452 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-981f5ff9-0cbd-4056-8ee5-ac3258eb8872 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:43.889293 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9647745e-a1a7-42f0-a9d9-d0cbfa4ab1e0 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:43.897814 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9647745e-a1a7-42f0-a9d9-d0cbfa4ab1e0 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 200 len: 1366 microversion: 2.1 time: 0.206038 Aug 01 14:22:43.903617 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 153/312] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:43 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:43.909240 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-17652194-be4c-449e-b40a-b8de77d9aef3 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:43.910213 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-17652194-be4c-449e-b40a-b8de77d9aef3 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:43.919363 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-17652194-be4c-449e-b40a-b8de77d9aef3 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:43.920118 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-17652194-be4c-449e-b40a-b8de77d9aef3 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:43.921098 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-17652194-be4c-449e-b40a-b8de77d9aef3 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:43.921856 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-17652194-be4c-449e-b40a-b8de77d9aef3 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:43.965843 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-981f5ff9-0cbd-4056-8ee5-ac3258eb8872 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:43.973696 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-981f5ff9-0cbd-4056-8ee5-ac3258eb8872 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1314 microversion: 2.1 time: 0.223627 Aug 01 14:22:43.988137 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 160/313] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:43 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:44.102548 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-17652194-be4c-449e-b40a-b8de77d9aef3 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:44.111490 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-17652194-be4c-449e-b40a-b8de77d9aef3 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4" status: 200 len: 1512 microversion: 2.1 time: 0.206501 Aug 01 14:22:44.112306 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 154/314] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:43 2022] GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 => generated 1512 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:44.376098 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8d458a68-e368-4ad8-bfdb-3275a8c0f2c6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:44.377253 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8d458a68-e368-4ad8-bfdb-3275a8c0f2c6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:44.385053 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8d458a68-e368-4ad8-bfdb-3275a8c0f2c6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:44.385786 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8d458a68-e368-4ad8-bfdb-3275a8c0f2c6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:44.387738 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8d458a68-e368-4ad8-bfdb-3275a8c0f2c6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:44.388342 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8d458a68-e368-4ad8-bfdb-3275a8c0f2c6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:44.538121 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8d458a68-e368-4ad8-bfdb-3275a8c0f2c6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:44.547989 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8d458a68-e368-4ad8-bfdb-3275a8c0f2c6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:44.549961 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8d458a68-e368-4ad8-bfdb-3275a8c0f2c6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:44.551151 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8d458a68-e368-4ad8-bfdb-3275a8c0f2c6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1740 microversion: 2.20 time: 0.180001 Aug 01 14:22:44.570808 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-038aa473-8541-46f5-96f7-8d3052d3463b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:44.573811 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-038aa473-8541-46f5-96f7-8d3052d3463b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:44.578516 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 161/315] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:44 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:44.582892 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-038aa473-8541-46f5-96f7-8d3052d3463b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:44.583548 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-038aa473-8541-46f5-96f7-8d3052d3463b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:44.585147 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-038aa473-8541-46f5-96f7-8d3052d3463b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:44.585738 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-038aa473-8541-46f5-96f7-8d3052d3463b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:44.756567 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-038aa473-8541-46f5-96f7-8d3052d3463b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:44.770435 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-038aa473-8541-46f5-96f7-8d3052d3463b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.203335 Aug 01 14:22:44.783830 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 155/316] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:44 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:44.921533 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7c45fa58-536a-45d8-84ca-c2a8db987ddd tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:44.922146 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7c45fa58-536a-45d8-84ca-c2a8db987ddd tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:44.929199 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7c45fa58-536a-45d8-84ca-c2a8db987ddd tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:44.929652 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7c45fa58-536a-45d8-84ca-c2a8db987ddd tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:44.930427 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7c45fa58-536a-45d8-84ca-c2a8db987ddd tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:44.930856 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7c45fa58-536a-45d8-84ca-c2a8db987ddd tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:44.997748 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a1a47ee1-8ec5-43ce-8e36-c1cca0807f05 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:44.998347 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a1a47ee1-8ec5-43ce-8e36-c1cca0807f05 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:45.004567 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a1a47ee1-8ec5-43ce-8e36-c1cca0807f05 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:45.005302 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a1a47ee1-8ec5-43ce-8e36-c1cca0807f05 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:45.005783 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a1a47ee1-8ec5-43ce-8e36-c1cca0807f05 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:45.006209 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a1a47ee1-8ec5-43ce-8e36-c1cca0807f05 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:45.070641 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7c45fa58-536a-45d8-84ca-c2a8db987ddd tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:45.079270 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7c45fa58-536a-45d8-84ca-c2a8db987ddd tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 200 len: 1366 microversion: 2.1 time: 0.163354 Aug 01 14:22:45.079967 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 162/317] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:44 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:45.132558 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-533b84b6-ebd9-4f6f-9ace-9bc6e5175db5 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:45.133159 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-533b84b6-ebd9-4f6f-9ace-9bc6e5175db5 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:45.139299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-533b84b6-ebd9-4f6f-9ace-9bc6e5175db5 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:45.139784 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-533b84b6-ebd9-4f6f-9ace-9bc6e5175db5 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:45.140550 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-533b84b6-ebd9-4f6f-9ace-9bc6e5175db5 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:45.141589 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-533b84b6-ebd9-4f6f-9ace-9bc6e5175db5 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:45.147033 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a1a47ee1-8ec5-43ce-8e36-c1cca0807f05 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:45.154425 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a1a47ee1-8ec5-43ce-8e36-c1cca0807f05 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1314 microversion: 2.1 time: 0.161623 Aug 01 14:22:45.154985 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 156/318] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:44 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:45.335359 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-533b84b6-ebd9-4f6f-9ace-9bc6e5175db5 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:45.343214 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-533b84b6-ebd9-4f6f-9ace-9bc6e5175db5 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4" status: 200 len: 1512 microversion: 2.1 time: 0.214576 Aug 01 14:22:45.344153 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 163/319] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:45 2022] GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 => generated 1512 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:45.582509 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e1649e73-f10f-49ee-8b00-665cdde848c0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:45.583777 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e1649e73-f10f-49ee-8b00-665cdde848c0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:45.594978 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e1649e73-f10f-49ee-8b00-665cdde848c0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:45.596924 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e1649e73-f10f-49ee-8b00-665cdde848c0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:45.598529 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e1649e73-f10f-49ee-8b00-665cdde848c0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:45.600389 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e1649e73-f10f-49ee-8b00-665cdde848c0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:45.784136 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e1649e73-f10f-49ee-8b00-665cdde848c0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:45.794097 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0bf9be4c-5a3f-4f0c-a85f-e9fa7b72d957 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:45.798610 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0bf9be4c-5a3f-4f0c-a85f-e9fa7b72d957 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:45.807845 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0bf9be4c-5a3f-4f0c-a85f-e9fa7b72d957 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:45.808335 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0bf9be4c-5a3f-4f0c-a85f-e9fa7b72d957 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:45.809305 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0bf9be4c-5a3f-4f0c-a85f-e9fa7b72d957 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:45.809423 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e1649e73-f10f-49ee-8b00-665cdde848c0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:45.809821 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0bf9be4c-5a3f-4f0c-a85f-e9fa7b72d957 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:45.810966 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e1649e73-f10f-49ee-8b00-665cdde848c0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:45.812388 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e1649e73-f10f-49ee-8b00-665cdde848c0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1740 microversion: 2.20 time: 0.234469 Aug 01 14:22:45.813608 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 157/320] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:45 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1740 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:45.962023 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0bf9be4c-5a3f-4f0c-a85f-e9fa7b72d957 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:45.970482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0bf9be4c-5a3f-4f0c-a85f-e9fa7b72d957 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.180487 Aug 01 14:22:45.983972 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 164/321] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:45 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:46.102494 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d50ca437-7624-44dc-8408-08d39c147361 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:46.103109 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d50ca437-7624-44dc-8408-08d39c147361 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:46.117678 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d50ca437-7624-44dc-8408-08d39c147361 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:46.118512 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d50ca437-7624-44dc-8408-08d39c147361 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:46.119622 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d50ca437-7624-44dc-8408-08d39c147361 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:46.120226 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d50ca437-7624-44dc-8408-08d39c147361 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:46.183975 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6614a9fe-c330-431b-9dc3-965f44604496 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:46.186968 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-6614a9fe-c330-431b-9dc3-965f44604496 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:46.209705 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6614a9fe-c330-431b-9dc3-965f44604496 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:46.210801 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6614a9fe-c330-431b-9dc3-965f44604496 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:46.211948 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6614a9fe-c330-431b-9dc3-965f44604496 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:46.212632 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6614a9fe-c330-431b-9dc3-965f44604496 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:46.341289 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d50ca437-7624-44dc-8408-08d39c147361 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:46.359369 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d50ca437-7624-44dc-8408-08d39c147361 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 200 len: 1366 microversion: 2.1 time: 0.259938 Aug 01 14:22:46.360637 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 158/322] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:46 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:46.365927 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-24f6352a-4711-4ff5-b981-d3675ba0ca14 req-b9151637-2b31-44b5-b3be-ce67a59e951f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af4ff82b-d3d6-42c8-aeee-186eacd74c9d", "name": "network-vif-plugged", "status": "completed", "tag": "67dc1e44-3667-466f-9a2c-ce4f193e8d0d"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:46.379648 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-24f6352a-4711-4ff5-b981-d3675ba0ca14 req-b9151637-2b31-44b5-b3be-ce67a59e951f service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:46.380428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-24f6352a-4711-4ff5-b981-d3675ba0ca14 req-b9151637-2b31-44b5-b3be-ce67a59e951f service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:46.402329 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-24f6352a-4711-4ff5-b981-d3675ba0ca14 req-b9151637-2b31-44b5-b3be-ce67a59e951f service nova] Creating event network-vif-plugged:67dc1e44-3667-466f-9a2c-ce4f193e8d0d for instance af4ff82b-d3d6-42c8-aeee-186eacd74c9d on hv-cinder-84599 Aug 01 14:22:46.412468 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-24f6352a-4711-4ff5-b981-d3675ba0ca14 req-b9151637-2b31-44b5-b3be-ce67a59e951f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050363 Aug 01 14:22:46.416238 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 159/323] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:22:46.428465 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-18ffbd1d-58ba-4916-912c-d7fda0a7d90a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:46.433677 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-18ffbd1d-58ba-4916-912c-d7fda0a7d90a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:46.449335 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-18ffbd1d-58ba-4916-912c-d7fda0a7d90a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:46.449787 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-18ffbd1d-58ba-4916-912c-d7fda0a7d90a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:46.450571 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-18ffbd1d-58ba-4916-912c-d7fda0a7d90a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:46.451003 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-18ffbd1d-58ba-4916-912c-d7fda0a7d90a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:46.525976 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6614a9fe-c330-431b-9dc3-965f44604496 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:46.536033 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6614a9fe-c330-431b-9dc3-965f44604496 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1498 microversion: 2.1 time: 0.363474 Aug 01 14:22:46.549167 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 165/324] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:46 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1498 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:46.692533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-18ffbd1d-58ba-4916-912c-d7fda0a7d90a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:46.702251 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-18ffbd1d-58ba-4916-912c-d7fda0a7d90a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4" status: 200 len: 1512 microversion: 2.1 time: 0.281802 Aug 01 14:22:46.703332 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 160/325] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:46 2022] GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 => generated 1512 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:46.838727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-354e6803-fcd1-4f74-9b80-88bba671a010 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:46.839337 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-354e6803-fcd1-4f74-9b80-88bba671a010 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:46.847581 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-354e6803-fcd1-4f74-9b80-88bba671a010 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:46.848042 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-354e6803-fcd1-4f74-9b80-88bba671a010 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:46.848874 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-354e6803-fcd1-4f74-9b80-88bba671a010 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:46.849316 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-354e6803-fcd1-4f74-9b80-88bba671a010 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:46.992393 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e9dff4f9-5ddb-48ca-8c62-a2e78d2f49e3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:46.993276 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e9dff4f9-5ddb-48ca-8c62-a2e78d2f49e3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:47.000493 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e9dff4f9-5ddb-48ca-8c62-a2e78d2f49e3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:47.001217 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e9dff4f9-5ddb-48ca-8c62-a2e78d2f49e3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:47.002213 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e9dff4f9-5ddb-48ca-8c62-a2e78d2f49e3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:47.002812 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e9dff4f9-5ddb-48ca-8c62-a2e78d2f49e3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:47.208301 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e9dff4f9-5ddb-48ca-8c62-a2e78d2f49e3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:47.221833 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e9dff4f9-5ddb-48ca-8c62-a2e78d2f49e3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.233459 Aug 01 14:22:47.223078 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 161/326] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:46 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:47.298027 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-354e6803-fcd1-4f74-9b80-88bba671a010 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:47.313439 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-354e6803-fcd1-4f74-9b80-88bba671a010 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:47.320108 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-354e6803-fcd1-4f74-9b80-88bba671a010 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:47.323613 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-354e6803-fcd1-4f74-9b80-88bba671a010 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1740 microversion: 2.20 time: 0.489175 Aug 01 14:22:47.328313 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 166/327] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:46 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1740 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:47.373284 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-09c32c58-f25f-494b-900a-875d42ba4d2e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:47.373786 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-09c32c58-f25f-494b-900a-875d42ba4d2e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:47.386708 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7896cee1-7484-4552-a89a-186d1bd3fd0c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:47.389576 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7896cee1-7484-4552-a89a-186d1bd3fd0c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:47.391115 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-09c32c58-f25f-494b-900a-875d42ba4d2e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:47.391807 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-09c32c58-f25f-494b-900a-875d42ba4d2e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:47.392789 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-09c32c58-f25f-494b-900a-875d42ba4d2e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:47.393392 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-09c32c58-f25f-494b-900a-875d42ba4d2e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:47.404689 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7896cee1-7484-4552-a89a-186d1bd3fd0c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:47.407096 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7896cee1-7484-4552-a89a-186d1bd3fd0c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:47.408175 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7896cee1-7484-4552-a89a-186d1bd3fd0c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:47.408830 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7896cee1-7484-4552-a89a-186d1bd3fd0c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:47.436967 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-09c32c58-f25f-494b-900a-875d42ba4d2e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Going to try to terminate instance {{(pid=118132) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:22:47.440973 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=100 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:47.576518 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-09c32c58-f25f-494b-900a-875d42ba4d2e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "DELETE /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 204 len: 0 microversion: 2.1 time: 0.207008 Aug 01 14:22:47.577023 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 162/328] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Aug 1 14:22:47 2022] DELETE /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:22:47.589220 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c21cbfa4-2c52-4028-994f-d5eab862ef7d tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:47.591870 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c21cbfa4-2c52-4028-994f-d5eab862ef7d tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:47.602661 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c21cbfa4-2c52-4028-994f-d5eab862ef7d tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:47.603414 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c21cbfa4-2c52-4028-994f-d5eab862ef7d tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:47.604453 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c21cbfa4-2c52-4028-994f-d5eab862ef7d tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:47.605080 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c21cbfa4-2c52-4028-994f-d5eab862ef7d tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:47.740977 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7896cee1-7484-4552-a89a-186d1bd3fd0c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:47.754130 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7896cee1-7484-4552-a89a-186d1bd3fd0c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 200 len: 1366 microversion: 2.1 time: 0.372193 Aug 01 14:22:47.755142 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 167/329] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:47 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 1366 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:47.761506 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-ee9cee1b-b53c-43f3-92c0-22429ed65962 req-cc8a8dca-b8b9-4f6d-bea1-68278f6dace8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4345a2fe-05f1-4129-84c7-0bc44c0fdff4", "name": "network-vif-deleted", "tag": "2a8ab380-8d50-4bde-acfd-f07858043d9e"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:47.785633 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-ee9cee1b-b53c-43f3-92c0-22429ed65962 req-cc8a8dca-b8b9-4f6d-bea1-68278f6dace8 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:47.786446 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-ee9cee1b-b53c-43f3-92c0-22429ed65962 req-cc8a8dca-b8b9-4f6d-bea1-68278f6dace8 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:47.801435 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-ee9cee1b-b53c-43f3-92c0-22429ed65962 req-cc8a8dca-b8b9-4f6d-bea1-68278f6dace8 service nova] Creating event network-vif-deleted:2a8ab380-8d50-4bde-acfd-f07858043d9e for instance 4345a2fe-05f1-4129-84c7-0bc44c0fdff4 on hv-cinder-84599 Aug 01 14:22:47.809333 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-ee9cee1b-b53c-43f3-92c0-22429ed65962 req-cc8a8dca-b8b9-4f6d-bea1-68278f6dace8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049229 Aug 01 14:22:47.811677 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 168/330] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:22:47.825775 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-90c5dce7-0634-4a05-92ac-516a13a689c7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:47.829057 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-90c5dce7-0634-4a05-92ac-516a13a689c7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:47.845598 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-90c5dce7-0634-4a05-92ac-516a13a689c7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:47.846969 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-90c5dce7-0634-4a05-92ac-516a13a689c7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:47.849382 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-90c5dce7-0634-4a05-92ac-516a13a689c7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:47.850043 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-90c5dce7-0634-4a05-92ac-516a13a689c7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:47.905784 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c21cbfa4-2c52-4028-994f-d5eab862ef7d tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:47.917460 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c21cbfa4-2c52-4028-994f-d5eab862ef7d tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1504 microversion: 2.1 time: 0.335858 Aug 01 14:22:47.932130 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 163/331] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:47 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1504 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:47.970448 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-90c5dce7-0634-4a05-92ac-516a13a689c7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:47.993892 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-90c5dce7-0634-4a05-92ac-516a13a689c7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4" status: 200 len: 1303 microversion: 2.1 time: 0.179530 Aug 01 14:22:47.996750 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 169/332] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:47 2022] GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 => generated 1303 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:48.244022 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b1385367-7e08-4c33-8593-001ef06d4414 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:48.244744 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b1385367-7e08-4c33-8593-001ef06d4414 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:48.252876 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b1385367-7e08-4c33-8593-001ef06d4414 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:48.253595 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b1385367-7e08-4c33-8593-001ef06d4414 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:48.254374 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b1385367-7e08-4c33-8593-001ef06d4414 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:48.254804 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b1385367-7e08-4c33-8593-001ef06d4414 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:48.360562 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-bd3fb187-e65d-4a35-b43f-4ae168e98548 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:48.360562 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-bd3fb187-e65d-4a35-b43f-4ae168e98548 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:48.367198 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bd3fb187-e65d-4a35-b43f-4ae168e98548 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:48.367887 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bd3fb187-e65d-4a35-b43f-4ae168e98548 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:48.369259 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bd3fb187-e65d-4a35-b43f-4ae168e98548 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:48.369848 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bd3fb187-e65d-4a35-b43f-4ae168e98548 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:48.419116 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b1385367-7e08-4c33-8593-001ef06d4414 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:48.430620 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b1385367-7e08-4c33-8593-001ef06d4414 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.190325 Aug 01 14:22:48.431294 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 164/333] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:48 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:48.515323 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-bd3fb187-e65d-4a35-b43f-4ae168e98548 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:48.524304 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-bd3fb187-e65d-4a35-b43f-4ae168e98548 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:48.525848 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-bd3fb187-e65d-4a35-b43f-4ae168e98548 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:48.527011 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-bd3fb187-e65d-4a35-b43f-4ae168e98548 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1740 microversion: 2.20 time: 0.174768 Aug 01 14:22:48.527580 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 170/334] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:48 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:22:48.777530 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-90b1bec2-dc59-499a-b28f-6db4121e4a58 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:48.778145 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-90b1bec2-dc59-499a-b28f-6db4121e4a58 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:48.786377 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-90b1bec2-dc59-499a-b28f-6db4121e4a58 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:48.786816 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-90b1bec2-dc59-499a-b28f-6db4121e4a58 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:48.787599 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-90b1bec2-dc59-499a-b28f-6db4121e4a58 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:48.788023 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-90b1bec2-dc59-499a-b28f-6db4121e4a58 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:48.922827 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-90b1bec2-dc59-499a-b28f-6db4121e4a58 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:48.930601 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-90b1bec2-dc59-499a-b28f-6db4121e4a58 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 200 len: 1366 microversion: 2.1 time: 0.157243 Aug 01 14:22:48.931165 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 165/335] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:48 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:48.944757 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-496a81b5-fa74-4661-a70b-204a5e45f94a tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:48.945344 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-496a81b5-fa74-4661-a70b-204a5e45f94a tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:48.952469 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-496a81b5-fa74-4661-a70b-204a5e45f94a tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:48.952908 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-496a81b5-fa74-4661-a70b-204a5e45f94a tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:48.954208 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-496a81b5-fa74-4661-a70b-204a5e45f94a tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:48.954629 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-496a81b5-fa74-4661-a70b-204a5e45f94a tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:49.018686 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4b6f498a-56d6-4807-aac3-09d72057d542 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:49.019662 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4b6f498a-56d6-4807-aac3-09d72057d542 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:49.026061 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4b6f498a-56d6-4807-aac3-09d72057d542 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:49.026783 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4b6f498a-56d6-4807-aac3-09d72057d542 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:49.027508 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4b6f498a-56d6-4807-aac3-09d72057d542 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:49.027990 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4b6f498a-56d6-4807-aac3-09d72057d542 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:49.101912 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-496a81b5-fa74-4661-a70b-204a5e45f94a tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:49.103380 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4b6f498a-56d6-4807-aac3-09d72057d542 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:49.112810 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-496a81b5-fa74-4661-a70b-204a5e45f94a tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1504 microversion: 2.1 time: 0.172136 Aug 01 14:22:49.113734 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 171/336] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:48 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:49.113894 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4b6f498a-56d6-4807-aac3-09d72057d542 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4" status: 200 len: 1303 microversion: 2.1 time: 0.099524 Aug 01 14:22:49.114666 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 166/337] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:49 2022] GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:49.452820 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-fb745623-81ec-47c4-8fde-21c8e1b01056 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:49.454625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-fb745623-81ec-47c4-8fde-21c8e1b01056 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:49.464915 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fb745623-81ec-47c4-8fde-21c8e1b01056 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:49.465591 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fb745623-81ec-47c4-8fde-21c8e1b01056 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:49.466895 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fb745623-81ec-47c4-8fde-21c8e1b01056 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:49.467546 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fb745623-81ec-47c4-8fde-21c8e1b01056 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:49.550312 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-53f86e59-d2a9-493a-86de-368f8e2ef687 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:49.550904 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-53f86e59-d2a9-493a-86de-368f8e2ef687 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:49.557028 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-53f86e59-d2a9-493a-86de-368f8e2ef687 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:49.557472 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-53f86e59-d2a9-493a-86de-368f8e2ef687 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:49.558236 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-53f86e59-d2a9-493a-86de-368f8e2ef687 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:49.558659 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-53f86e59-d2a9-493a-86de-368f8e2ef687 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:49.608097 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-fb745623-81ec-47c4-8fde-21c8e1b01056 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:49.616336 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-fb745623-81ec-47c4-8fde-21c8e1b01056 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.168592 Aug 01 14:22:49.617200 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 172/338] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:49 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:49.707512 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-53f86e59-d2a9-493a-86de-368f8e2ef687 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:49.716676 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-53f86e59-d2a9-493a-86de-368f8e2ef687 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:49.718900 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-53f86e59-d2a9-493a-86de-368f8e2ef687 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:49.720444 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-53f86e59-d2a9-493a-86de-368f8e2ef687 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1740 microversion: 2.20 time: 0.174084 Aug 01 14:22:49.721652 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 167/339] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:49 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:22:49.951254 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b8f2f18a-e4b7-438f-b172-c6aeae532474 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:49.951876 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b8f2f18a-e4b7-438f-b172-c6aeae532474 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:49.958437 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b8f2f18a-e4b7-438f-b172-c6aeae532474 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:49.958814 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b8f2f18a-e4b7-438f-b172-c6aeae532474 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:49.959602 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b8f2f18a-e4b7-438f-b172-c6aeae532474 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:49.960033 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b8f2f18a-e4b7-438f-b172-c6aeae532474 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:49.978198 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=100 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:50.105688 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b8f2f18a-e4b7-438f-b172-c6aeae532474 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:50.114507 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b8f2f18a-e4b7-438f-b172-c6aeae532474 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 200 len: 1555 microversion: 2.1 time: 0.167057 Aug 01 14:22:50.116943 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 173/340] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:49 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:50.135655 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e1246b38-c7c9-4555-83e8-1f473f09b685 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:50.136221 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e1246b38-c7c9-4555-83e8-1f473f09b685 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:50.137496 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-2cf7cccc-a396-4c63-89b8-b27feb16a8fd tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:50.138096 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-2cf7cccc-a396-4c63-89b8-b27feb16a8fd tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:50.142798 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e1246b38-c7c9-4555-83e8-1f473f09b685 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:50.143932 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e1246b38-c7c9-4555-83e8-1f473f09b685 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:50.144183 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2cf7cccc-a396-4c63-89b8-b27feb16a8fd tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:50.144631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2cf7cccc-a396-4c63-89b8-b27feb16a8fd tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:50.144795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e1246b38-c7c9-4555-83e8-1f473f09b685 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:50.145246 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e1246b38-c7c9-4555-83e8-1f473f09b685 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:50.145384 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2cf7cccc-a396-4c63-89b8-b27feb16a8fd tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:50.145808 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2cf7cccc-a396-4c63-89b8-b27feb16a8fd tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:50.177200 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2cf7cccc-a396-4c63-89b8-b27feb16a8fd tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:50.177586 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2cf7cccc-a396-4c63-89b8-b27feb16a8fd tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:50.178034 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-2cf7cccc-a396-4c63-89b8-b27feb16a8fd tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lazy-loading 'fault' on Instance uuid 4345a2fe-05f1-4129-84c7-0bc44c0fdff4 {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:22:50.230351 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e1246b38-c7c9-4555-83e8-1f473f09b685 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098557 Aug 01 14:22:50.230953 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2cf7cccc-a396-4c63-89b8-b27feb16a8fd tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:50.231324 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 168/341] 10.222.0.17 () {58 vars in 1275 bytes} [Mon Aug 1 14:22:50 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:22:50.237187 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0ff463d0-f555-4855-8880-26be0aa21798 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:50.237799 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0ff463d0-f555-4855-8880-26be0aa21798 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:50.239834 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-2cf7cccc-a396-4c63-89b8-b27feb16a8fd tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4" status: 200 len: 1308 microversion: 2.1 time: 0.106018 Aug 01 14:22:50.240398 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 174/342] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:50 2022] GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:50.244481 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0ff463d0-f555-4855-8880-26be0aa21798 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:50.245047 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0ff463d0-f555-4855-8880-26be0aa21798 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:50.245922 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0ff463d0-f555-4855-8880-26be0aa21798 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:50.246461 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0ff463d0-f555-4855-8880-26be0aa21798 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:50.402225 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0ff463d0-f555-4855-8880-26be0aa21798 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:50.418194 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0ff463d0-f555-4855-8880-26be0aa21798 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1504 microversion: 2.1 time: 0.185260 Aug 01 14:22:50.418808 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 169/343] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:50 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1504 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:50.650458 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a1c06299-9c34-4a51-966e-d8588eb5c0b5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:50.651211 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a1c06299-9c34-4a51-966e-d8588eb5c0b5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:50.665273 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a1c06299-9c34-4a51-966e-d8588eb5c0b5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:50.665817 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a1c06299-9c34-4a51-966e-d8588eb5c0b5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:50.666889 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a1c06299-9c34-4a51-966e-d8588eb5c0b5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:50.667350 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a1c06299-9c34-4a51-966e-d8588eb5c0b5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:50.748674 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9eb1b703-cf86-4110-b688-5a8f24b7d4b3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:50.749709 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9eb1b703-cf86-4110-b688-5a8f24b7d4b3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:50.762732 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9eb1b703-cf86-4110-b688-5a8f24b7d4b3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:50.764008 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9eb1b703-cf86-4110-b688-5a8f24b7d4b3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:50.766262 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9eb1b703-cf86-4110-b688-5a8f24b7d4b3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:50.767347 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9eb1b703-cf86-4110-b688-5a8f24b7d4b3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:51.009333 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9eb1b703-cf86-4110-b688-5a8f24b7d4b3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:51.021473 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9eb1b703-cf86-4110-b688-5a8f24b7d4b3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:51.026305 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9eb1b703-cf86-4110-b688-5a8f24b7d4b3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:51.028000 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9eb1b703-cf86-4110-b688-5a8f24b7d4b3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1722 microversion: 2.20 time: 0.286511 Aug 01 14:22:51.028826 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 170/344] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:50 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1722 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:22:51.145153 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a1c06299-9c34-4a51-966e-d8588eb5c0b5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:51.155565 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a1c06299-9c34-4a51-966e-d8588eb5c0b5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.515630 Aug 01 14:22:51.171132 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 175/345] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:50 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:51.261929 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9789c636-2cab-419e-a6e7-4cad45d9b233 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:51.263120 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9789c636-2cab-419e-a6e7-4cad45d9b233 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 4345a2fe-05f1-4129-84c7-0bc44c0fdff4] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:51.271572 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9789c636-2cab-419e-a6e7-4cad45d9b233 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:51.272043 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9789c636-2cab-419e-a6e7-4cad45d9b233 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:51.272811 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9789c636-2cab-419e-a6e7-4cad45d9b233 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:51.273241 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9789c636-2cab-419e-a6e7-4cad45d9b233 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:51.292052 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-9789c636-2cab-419e-a6e7-4cad45d9b233 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] HTTP exception thrown: Instance 4345a2fe-05f1-4129-84c7-0bc44c0fdff4 could not be found. Aug 01 14:22:51.297708 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9789c636-2cab-419e-a6e7-4cad45d9b233 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Request method failure captured: Aug 01 14:22:51.297708 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 HTTP/1.1 Aug 01 14:22:51.297708 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept: application/json Aug 01 14:22:51.297708 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Aug 01 14:22:51.297708 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Connection: close Aug 01 14:22:51.297708 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Length: 0 Aug 01 14:22:51.297708 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Type: application/json Aug 01 14:22:51.297708 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Host: 10.222.0.17 Aug 01 14:22:51.297708 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Aug 01 14:22:51.297708 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.10 Aug 01 14:22:51.297708 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABi5-FO2wlExb1kkJhcvTrx3y6fIdhT-B2RqNZqdwvqiz7S_dEZPRjv0xcocWDrxk-SJfUvTjq_8vqFPUCSJG3PKq7RN_025_IchPGaNnwXbT1MOFTeTSaZysDklnUw69ljoqCA60bXEhkzfIR0PoVZqv5J1_HmPeHyKc_DluGL96cI1Ew Aug 01 14:22:51.297708 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Aug 01 14:22:51.297708 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Aug 01 14:22:51.297708 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Aug 01 14:22:51.297708 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Aug 01 14:22:51.297708 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Aug 01 14:22:51.297708 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Aug 01 14:22:51.297708 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Id: 486a69a51709439aad36192aece6133e Aug 01 14:22:51.297708 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1215587601 Aug 01 14:22:51.297708 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Role: reader,member Aug 01 14:22:51.297708 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Roles: reader,member Aug 01 14:22:51.299216 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/486a69a51709439aad36192aece6133e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/486a69a51709439aad36192aece6133e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/486a69a51709439aad36192aece6133e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_486a69a51709439aad36192aece6133e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:22:51.299216 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-VolumesSnapshotTestJSON-1215587601 Aug 01 14:22:51.299216 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 486a69a51709439aad36192aece6133e Aug 01 14:22:51.299216 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1215587601 Aug 01 14:22:51.299216 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User: tempest-VolumesSnapshotTestJSON-1215587601-project Aug 01 14:22:51.299216 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Aug 01 14:22:51.299216 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Aug 01 14:22:51.299216 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Id: 0f6938e54a8d49a6b00d3a6694d4e57f Aug 01 14:22:51.299216 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-VolumesSnapshotTestJSON-1215587601-project Aug 01 14:22:51.299216 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: method: > Aug 01 14:22:51.299216 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: exception: Instance 4345a2fe-05f1-4129-84c7-0bc44c0fdff4 could not be found. Aug 01 14:22:51.299216 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: action_args: {'id': '4345a2fe-05f1-4129-84c7-0bc44c0fdff4'} Aug 01 14:22:51.299976 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:22:51.299976 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:51.299976 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:22:51.299976 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:22:51.299976 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:22:51.299976 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:22:51.299976 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:22:51.299976 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:22:51.299976 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:22:51.299976 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:22:51.299976 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4345a2fe-05f1-4129-84c7-0bc44c0fdff4 could not be found. Aug 01 14:22:51.299976 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:22:51.299976 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:22:51.299976 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:22:51.299976 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:51.299976 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:22:51.299976 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:22:51.299976 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:22:51.299976 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:22:51.299976 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:22:51.302912 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:22:51.302912 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:22:51.302912 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:22:51.302912 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:22:51.302912 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:22:51.302912 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:22:51.302912 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:22:51.302912 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4345a2fe-05f1-4129-84c7-0bc44c0fdff4 could not be found. Aug 01 14:22:51.302912 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:22:51.302912 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:22:51.302912 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:22:51.302912 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:51.302912 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:22:51.302912 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:22:51.302912 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:22:51.302912 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:22:51.302912 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4345a2fe-05f1-4129-84c7-0bc44c0fdff4 could not be found. Aug 01 14:22:51.302912 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:22:51.305173 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9789c636-2cab-419e-a6e7-4cad45d9b233 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Returning 404 to user: Instance 4345a2fe-05f1-4129-84c7-0bc44c0fdff4 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:22:51.305173 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9789c636-2cab-419e-a6e7-4cad45d9b233 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4" status: 404 len: 111 microversion: 2.1 time: 0.038181 Aug 01 14:22:51.305173 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 171/346] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:51 2022] GET /compute/v2.1/servers/4345a2fe-05f1-4129-84c7-0bc44c0fdff4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 14:22:51.441749 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a4dab523-bf76-4374-b6cf-f767c7514ef2 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:51.442368 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a4dab523-bf76-4374-b6cf-f767c7514ef2 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:51.449280 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a4dab523-bf76-4374-b6cf-f767c7514ef2 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:51.449959 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a4dab523-bf76-4374-b6cf-f767c7514ef2 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:51.451187 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a4dab523-bf76-4374-b6cf-f767c7514ef2 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:51.451948 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a4dab523-bf76-4374-b6cf-f767c7514ef2 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:51.992959 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a4dab523-bf76-4374-b6cf-f767c7514ef2 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:52.001398 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a4dab523-bf76-4374-b6cf-f767c7514ef2 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1504 microversion: 2.1 time: 0.563776 Aug 01 14:22:52.002372 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 176/347] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:51 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1504 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:52.054208 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c96a50f3-71cb-4c59-89be-e6258ce1f31a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:52.055319 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c96a50f3-71cb-4c59-89be-e6258ce1f31a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:52.061611 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c96a50f3-71cb-4c59-89be-e6258ce1f31a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:52.062057 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c96a50f3-71cb-4c59-89be-e6258ce1f31a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:52.063583 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c96a50f3-71cb-4c59-89be-e6258ce1f31a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:52.064016 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c96a50f3-71cb-4c59-89be-e6258ce1f31a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:52.178845 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8ea3cc72-c931-4b82-b938-f499cd0c29dd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:52.178845 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8ea3cc72-c931-4b82-b938-f499cd0c29dd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:52.189009 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8ea3cc72-c931-4b82-b938-f499cd0c29dd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:52.189886 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8ea3cc72-c931-4b82-b938-f499cd0c29dd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:52.190873 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8ea3cc72-c931-4b82-b938-f499cd0c29dd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:52.192160 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8ea3cc72-c931-4b82-b938-f499cd0c29dd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:52.238708 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c96a50f3-71cb-4c59-89be-e6258ce1f31a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:52.252401 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c96a50f3-71cb-4c59-89be-e6258ce1f31a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:52.256149 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c96a50f3-71cb-4c59-89be-e6258ce1f31a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:52.258651 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c96a50f3-71cb-4c59-89be-e6258ce1f31a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1722 microversion: 2.20 time: 0.208739 Aug 01 14:22:52.259888 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 172/348] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:52 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:22:52.268787 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-7fc228ce-9452-4425-9025-757cfa3b0c1d req-5b9c68dd-8304-48cf-aa40-bd7981f0b0d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15f45ea0-8c33-457c-88d7-e027e4a9109e", "name": "network-vif-deleted", "tag": "726cf288-ee4a-4a3b-8fd7-a4a8bcff4423"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:52.286198 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-7fc228ce-9452-4425-9025-757cfa3b0c1d req-5b9c68dd-8304-48cf-aa40-bd7981f0b0d3 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:52.286567 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-7fc228ce-9452-4425-9025-757cfa3b0c1d req-5b9c68dd-8304-48cf-aa40-bd7981f0b0d3 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:52.299274 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-7fc228ce-9452-4425-9025-757cfa3b0c1d req-5b9c68dd-8304-48cf-aa40-bd7981f0b0d3 service nova] Creating event network-vif-deleted:726cf288-ee4a-4a3b-8fd7-a4a8bcff4423 for instance 15f45ea0-8c33-457c-88d7-e027e4a9109e on hv-cinder-84599 Aug 01 14:22:52.304572 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-7fc228ce-9452-4425-9025-757cfa3b0c1d req-5b9c68dd-8304-48cf-aa40-bd7981f0b0d3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042784 Aug 01 14:22:52.305182 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 173/349] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:22:52.465960 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8ea3cc72-c931-4b82-b938-f499cd0c29dd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:52.475004 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8ea3cc72-c931-4b82-b938-f499cd0c29dd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.300593 Aug 01 14:22:52.476584 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 177/350] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:52 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:53.024379 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c939f943-80c1-4dad-b020-084f8df6ed30 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:53.025067 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c939f943-80c1-4dad-b020-084f8df6ed30 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:53.031239 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c939f943-80c1-4dad-b020-084f8df6ed30 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:53.031720 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c939f943-80c1-4dad-b020-084f8df6ed30 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:53.032558 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c939f943-80c1-4dad-b020-084f8df6ed30 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:53.032992 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c939f943-80c1-4dad-b020-084f8df6ed30 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:53.103081 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c939f943-80c1-4dad-b020-084f8df6ed30 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:53.111325 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c939f943-80c1-4dad-b020-084f8df6ed30 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1462 microversion: 2.1 time: 0.091111 Aug 01 14:22:53.111943 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 174/351] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:53 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1462 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:53.282848 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7f9e1201-0dba-4eb2-9609-0079e5889172 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:53.283442 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7f9e1201-0dba-4eb2-9609-0079e5889172 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:53.290299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7f9e1201-0dba-4eb2-9609-0079e5889172 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:53.290744 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7f9e1201-0dba-4eb2-9609-0079e5889172 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:53.291533 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7f9e1201-0dba-4eb2-9609-0079e5889172 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:53.291961 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7f9e1201-0dba-4eb2-9609-0079e5889172 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:53.429688 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7f9e1201-0dba-4eb2-9609-0079e5889172 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:53.440827 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7f9e1201-0dba-4eb2-9609-0079e5889172 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:53.442320 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7f9e1201-0dba-4eb2-9609-0079e5889172 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:53.443499 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7f9e1201-0dba-4eb2-9609-0079e5889172 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1722 microversion: 2.20 time: 0.165145 Aug 01 14:22:53.444067 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 178/352] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:53 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:53.503392 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3d9a0e86-646b-43d8-b1f8-dc44fc5c4cce tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:53.505553 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3d9a0e86-646b-43d8-b1f8-dc44fc5c4cce tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:53.511266 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3d9a0e86-646b-43d8-b1f8-dc44fc5c4cce tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:53.511827 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3d9a0e86-646b-43d8-b1f8-dc44fc5c4cce tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:53.512675 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3d9a0e86-646b-43d8-b1f8-dc44fc5c4cce tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:53.513118 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3d9a0e86-646b-43d8-b1f8-dc44fc5c4cce tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:53.652678 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3d9a0e86-646b-43d8-b1f8-dc44fc5c4cce tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:53.661531 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3d9a0e86-646b-43d8-b1f8-dc44fc5c4cce tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.161833 Aug 01 14:22:53.661531 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 175/353] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:53 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:54.132366 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d74bdb32-420d-47d8-b32b-1737fa225e49 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:54.132970 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d74bdb32-420d-47d8-b32b-1737fa225e49 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:54.139654 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d74bdb32-420d-47d8-b32b-1737fa225e49 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:54.140108 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d74bdb32-420d-47d8-b32b-1737fa225e49 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:54.140894 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d74bdb32-420d-47d8-b32b-1737fa225e49 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:54.141322 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d74bdb32-420d-47d8-b32b-1737fa225e49 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:54.221085 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d74bdb32-420d-47d8-b32b-1737fa225e49 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:54.228753 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d74bdb32-420d-47d8-b32b-1737fa225e49 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 200 len: 1462 microversion: 2.1 time: 0.100273 Aug 01 14:22:54.229774 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 179/354] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:54 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 1462 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:54.320770 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-24410ff7-75a2-476d-8ad9-481edb6dc2ba req-23d96502-1626-4f43-b0c0-650a94955447 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af4ff82b-d3d6-42c8-aeee-186eacd74c9d", "tag": "67dc1e44-3667-466f-9a2c-ce4f193e8d0d"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:54.330763 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-24410ff7-75a2-476d-8ad9-481edb6dc2ba req-23d96502-1626-4f43-b0c0-650a94955447 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:54.331197 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-24410ff7-75a2-476d-8ad9-481edb6dc2ba req-23d96502-1626-4f43-b0c0-650a94955447 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:54.342591 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-24410ff7-75a2-476d-8ad9-481edb6dc2ba req-23d96502-1626-4f43-b0c0-650a94955447 service nova] Creating event network-changed:67dc1e44-3667-466f-9a2c-ce4f193e8d0d for instance af4ff82b-d3d6-42c8-aeee-186eacd74c9d on hv-cinder-84599 Aug 01 14:22:54.348690 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-24410ff7-75a2-476d-8ad9-481edb6dc2ba req-23d96502-1626-4f43-b0c0-650a94955447 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031561 Aug 01 14:22:54.349293 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 176/355] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:22:54.467116 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-22944b89-3312-4fc4-a005-92f57bb107ca tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:54.468066 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-22944b89-3312-4fc4-a005-92f57bb107ca tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:54.475831 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-22944b89-3312-4fc4-a005-92f57bb107ca tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:54.476278 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-22944b89-3312-4fc4-a005-92f57bb107ca tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:54.477046 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-22944b89-3312-4fc4-a005-92f57bb107ca tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:54.477478 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-22944b89-3312-4fc4-a005-92f57bb107ca tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:54.685492 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7c9babfe-1ba5-40ee-a775-583fe5b52066 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:54.687289 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7c9babfe-1ba5-40ee-a775-583fe5b52066 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:54.695927 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7c9babfe-1ba5-40ee-a775-583fe5b52066 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:54.696866 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7c9babfe-1ba5-40ee-a775-583fe5b52066 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:54.697652 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7c9babfe-1ba5-40ee-a775-583fe5b52066 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:54.698232 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7c9babfe-1ba5-40ee-a775-583fe5b52066 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:54.758302 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-22944b89-3312-4fc4-a005-92f57bb107ca tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:54.783932 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-22944b89-3312-4fc4-a005-92f57bb107ca tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:54.785868 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-22944b89-3312-4fc4-a005-92f57bb107ca tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:54.787095 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-22944b89-3312-4fc4-a005-92f57bb107ca tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1722 microversion: 2.20 time: 0.324115 Aug 01 14:22:54.787715 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 180/356] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:54 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1722 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:54.911644 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c8548b93-2c26-4065-b258-e5cc321cd7b2 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-932052719", "imageRef": "9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1", "flavorRef": "452"}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:54.977229 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.network.neutron [None req-c8548b93-2c26-4065-b258-e5cc321cd7b2 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] validate_networks() for None {{(pid=118133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:22:55.203325 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7c9babfe-1ba5-40ee-a775-583fe5b52066 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:55.219703 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7c9babfe-1ba5-40ee-a775-583fe5b52066 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.540685 Aug 01 14:22:55.221351 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 177/357] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:54 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:55.253728 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-cb90d609-f983-42d6-8a88-88aa58c1a6f3 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:55.254490 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-cb90d609-f983-42d6-8a88-88aa58c1a6f3 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: 15f45ea0-8c33-457c-88d7-e027e4a9109e] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:55.261420 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cb90d609-f983-42d6-8a88-88aa58c1a6f3 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:55.262015 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cb90d609-f983-42d6-8a88-88aa58c1a6f3 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:55.263068 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cb90d609-f983-42d6-8a88-88aa58c1a6f3 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:55.263663 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cb90d609-f983-42d6-8a88-88aa58c1a6f3 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:55.279801 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-cb90d609-f983-42d6-8a88-88aa58c1a6f3 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] HTTP exception thrown: Instance 15f45ea0-8c33-457c-88d7-e027e4a9109e could not be found. Aug 01 14:22:55.281713 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-cb90d609-f983-42d6-8a88-88aa58c1a6f3 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Request method failure captured: Aug 01 14:22:55.281713 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e HTTP/1.1 Aug 01 14:22:55.281713 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept: application/json Aug 01 14:22:55.281713 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Aug 01 14:22:55.281713 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Connection: close Aug 01 14:22:55.281713 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Length: 0 Aug 01 14:22:55.281713 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Type: application/json Aug 01 14:22:55.281713 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Host: 10.222.0.17 Aug 01 14:22:55.281713 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Aug 01 14:22:55.281713 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.10 Aug 01 14:22:55.281713 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABi5-GFxbdjrwFdZren7AO9_AKYeM_pxcE9VH6kIVZb6K0ImNpX9YZM_oQ9gZS_edK4ZWneGdBEpWTTub7cJMyNUuXO9VT0E6LhGkdXNPDiD3iG-t7NUaYuJ_cemnHQpCvf82epVm9c6lv_O2_0BkJ17ja7vBCSOzO9nu7vSFmluYcC0Eo Aug 01 14:22:55.281713 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Aug 01 14:22:55.281713 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Aug 01 14:22:55.281713 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Aug 01 14:22:55.281713 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Aug 01 14:22:55.281713 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Aug 01 14:22:55.281713 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Aug 01 14:22:55.281713 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Id: d6dd5eef6c62467ab15a23233e366185 Aug 01 14:22:55.281713 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-VolumesActionsTest-962457200 Aug 01 14:22:55.281713 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Role: reader,member Aug 01 14:22:55.281713 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Roles: reader,member Aug 01 14:22:55.283679 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d6dd5eef6c62467ab15a23233e366185"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d6dd5eef6c62467ab15a23233e366185"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d6dd5eef6c62467ab15a23233e366185"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d6dd5eef6c62467ab15a23233e366185", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:22:55.283679 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-VolumesActionsTest-962457200 Aug 01 14:22:55.283679 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Id: d6dd5eef6c62467ab15a23233e366185 Aug 01 14:22:55.283679 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-VolumesActionsTest-962457200 Aug 01 14:22:55.283679 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User: tempest-VolumesActionsTest-962457200-project Aug 01 14:22:55.283679 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Aug 01 14:22:55.283679 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Aug 01 14:22:55.283679 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Id: bbbdf80e14b647cbbdb3d292d534d987 Aug 01 14:22:55.283679 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-VolumesActionsTest-962457200-project Aug 01 14:22:55.283679 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: method: > Aug 01 14:22:55.283679 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: exception: Instance 15f45ea0-8c33-457c-88d7-e027e4a9109e could not be found. Aug 01 14:22:55.283679 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: action_args: {'id': '15f45ea0-8c33-457c-88d7-e027e4a9109e'} Aug 01 14:22:55.284544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:22:55.284544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:55.284544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:22:55.284544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:22:55.284544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:22:55.284544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:22:55.284544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:22:55.284544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:22:55.284544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:22:55.284544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:22:55.284544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15f45ea0-8c33-457c-88d7-e027e4a9109e could not be found. Aug 01 14:22:55.284544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:22:55.284544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:22:55.284544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:22:55.284544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:55.284544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:22:55.284544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:22:55.284544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:22:55.284544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:22:55.284544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:22:55.285885 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:22:55.285885 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:22:55.285885 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:22:55.285885 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:22:55.285885 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:22:55.285885 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:22:55.285885 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:22:55.285885 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15f45ea0-8c33-457c-88d7-e027e4a9109e could not be found. Aug 01 14:22:55.285885 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:22:55.285885 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:22:55.285885 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:22:55.285885 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:55.285885 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:22:55.285885 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:22:55.285885 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:22:55.285885 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:22:55.285885 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15f45ea0-8c33-457c-88d7-e027e4a9109e could not be found. Aug 01 14:22:55.285885 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:22:55.287089 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-cb90d609-f983-42d6-8a88-88aa58c1a6f3 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Returning 404 to user: Instance 15f45ea0-8c33-457c-88d7-e027e4a9109e could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:22:55.287733 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-cb90d609-f983-42d6-8a88-88aa58c1a6f3 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e" status: 404 len: 111 microversion: 2.1 time: 0.039183 Aug 01 14:22:55.288418 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 178/358] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:55 2022] GET /compute/v2.1/servers/15f45ea0-8c33-457c-88d7-e027e4a9109e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 14:22:55.409291 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-913b75e8-3872-4231-a80b-6136bb4b7d4c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1699925025", "imageRef": "9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1", "flavorRef": "452", "networks": [{"uuid": "008507c5-1925-4e7a-8867-5e7af7f7fd82"}]}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:55.467647 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.network.neutron [None req-913b75e8-3872-4231-a80b-6136bb4b7d4c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] validate_networks() for [('008507c5-1925-4e7a-8867-5e7af7f7fd82', None, None, None, None, None)] {{(pid=118132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:22:55.503166 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-c8548b93-2c26-4065-b258-e5cc321cd7b2 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Flavor limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:22:55.503687 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-c8548b93-2c26-4065-b258-e5cc321cd7b2 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Image limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:22:55.504101 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-c8548b93-2c26-4065-b258-e5cc321cd7b2 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Flavor pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:22:55.504486 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-c8548b93-2c26-4065-b258-e5cc321cd7b2 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Image pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:22:55.504893 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-c8548b93-2c26-4065-b258-e5cc321cd7b2 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:22:55.514331 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c8548b93-2c26-4065-b258-e5cc321cd7b2 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:55.514781 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c8548b93-2c26-4065-b258-e5cc321cd7b2 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:55.516195 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c8548b93-2c26-4065-b258-e5cc321cd7b2 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:55.516710 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c8548b93-2c26-4065-b258-e5cc321cd7b2 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:55.534885 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-c8548b93-2c26-4065-b258-e5cc321cd7b2 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Getting quotas for project 27f6ab4a05704f8c97a5e1883becb247. Resources: {'instances', 'cores', 'ram'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:22:55.538965 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-c8548b93-2c26-4065-b258-e5cc321cd7b2 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Getting quotas for user a5711f44f73e4925ae52a784f43a2a1c and project 27f6ab4a05704f8c97a5e1883becb247. Resources: {'instances', 'cores', 'ram'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:22:55.568836 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c8548b93-2c26-4065-b258-e5cc321cd7b2 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Going to run 1 instances... {{(pid=118133) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:22:55.572175 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c8548b93-2c26-4065-b258-e5cc321cd7b2 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:22:55.644034 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c8548b93-2c26-4065-b258-e5cc321cd7b2 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.737078 Aug 01 14:22:55.646028 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 181/359] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Aug 1 14:22:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:22:55.658824 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-31b703b5-24e4-4255-a09e-1afb73505c78 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:55.659648 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-31b703b5-24e4-4255-a09e-1afb73505c78 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:55.733749 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-31b703b5-24e4-4255-a09e-1afb73505c78 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:55.744262 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-31b703b5-24e4-4255-a09e-1afb73505c78 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1214 microversion: 2.1 time: 0.090970 Aug 01 14:22:55.751586 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 182/360] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:55 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:55.814294 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0490bb45-9a65-4bd1-85ba-a4db57ec9f7f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:55.815406 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0490bb45-9a65-4bd1-85ba-a4db57ec9f7f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:55.825731 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0490bb45-9a65-4bd1-85ba-a4db57ec9f7f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:55.826174 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0490bb45-9a65-4bd1-85ba-a4db57ec9f7f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:55.827355 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0490bb45-9a65-4bd1-85ba-a4db57ec9f7f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:55.827355 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0490bb45-9a65-4bd1-85ba-a4db57ec9f7f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:55.934314 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-913b75e8-3872-4231-a80b-6136bb4b7d4c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Flavor limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:22:55.935143 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-913b75e8-3872-4231-a80b-6136bb4b7d4c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Image limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:22:55.935721 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-913b75e8-3872-4231-a80b-6136bb4b7d4c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Flavor pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:22:55.936431 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-913b75e8-3872-4231-a80b-6136bb4b7d4c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Image pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:22:55.936870 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-913b75e8-3872-4231-a80b-6136bb4b7d4c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:22:55.951800 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-913b75e8-3872-4231-a80b-6136bb4b7d4c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:55.952249 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-913b75e8-3872-4231-a80b-6136bb4b7d4c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:55.953193 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-913b75e8-3872-4231-a80b-6136bb4b7d4c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:55.957098 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-913b75e8-3872-4231-a80b-6136bb4b7d4c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:55.992804 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-913b75e8-3872-4231-a80b-6136bb4b7d4c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Getting quotas for project d6dd5eef6c62467ab15a23233e366185. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:22:55.998421 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-913b75e8-3872-4231-a80b-6136bb4b7d4c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Getting quotas for user bbbdf80e14b647cbbdb3d292d534d987 and project d6dd5eef6c62467ab15a23233e366185. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:22:56.014258 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-913b75e8-3872-4231-a80b-6136bb4b7d4c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Going to run 1 instances... {{(pid=118132) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:22:56.016750 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-913b75e8-3872-4231-a80b-6136bb4b7d4c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:22:56.090927 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-913b75e8-3872-4231-a80b-6136bb4b7d4c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.685741 Aug 01 14:22:56.103412 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 179/361] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Aug 1 14:22:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:22:56.111549 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6875b0d0-d6d4-45d4-8303-a7e0818a4a51 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:56.112357 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-6875b0d0-d6d4-45d4-8303-a7e0818a4a51 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:56.208505 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6875b0d0-d6d4-45d4-8303-a7e0818a4a51 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:56.218641 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6875b0d0-d6d4-45d4-8303-a7e0818a4a51 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1214 microversion: 2.1 time: 0.113546 Aug 01 14:22:56.219130 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 180/362] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:56 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1214 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:56.248294 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d320dffb-a6ca-44f3-b03e-b88692989813 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:56.249966 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d320dffb-a6ca-44f3-b03e-b88692989813 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:56.268542 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d320dffb-a6ca-44f3-b03e-b88692989813 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:56.270191 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d320dffb-a6ca-44f3-b03e-b88692989813 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:56.272274 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d320dffb-a6ca-44f3-b03e-b88692989813 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:56.274216 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d320dffb-a6ca-44f3-b03e-b88692989813 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:56.556417 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0490bb45-9a65-4bd1-85ba-a4db57ec9f7f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:56.573872 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0490bb45-9a65-4bd1-85ba-a4db57ec9f7f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:56.574750 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d320dffb-a6ca-44f3-b03e-b88692989813 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:56.584428 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0490bb45-9a65-4bd1-85ba-a4db57ec9f7f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:56.584621 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d320dffb-a6ca-44f3-b03e-b88692989813 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.345567 Aug 01 14:22:56.589623 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0490bb45-9a65-4bd1-85ba-a4db57ec9f7f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1722 microversion: 2.20 time: 0.783001 Aug 01 14:22:56.590675 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 183/363] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:55 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1722 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:56.596117 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 181/364] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:56 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:56.650055 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-f31beada-4649-42df-8f27-aefb613df1d1 req-a0a20d9e-8ef1-4312-94d9-1464cfe5d3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76deb7da-88aa-4c26-b55d-fd6432d1e680", "name": "network-vif-unplugged", "status": "completed", "tag": "e905a309-fe29-4762-880d-f6eb375da04f"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:56.669928 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-f31beada-4649-42df-8f27-aefb613df1d1 req-a0a20d9e-8ef1-4312-94d9-1464cfe5d3c2 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:56.670385 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-f31beada-4649-42df-8f27-aefb613df1d1 req-a0a20d9e-8ef1-4312-94d9-1464cfe5d3c2 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:56.685375 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-f31beada-4649-42df-8f27-aefb613df1d1 req-a0a20d9e-8ef1-4312-94d9-1464cfe5d3c2 service nova] Creating event network-vif-unplugged:e905a309-fe29-4762-880d-f6eb375da04f for instance 76deb7da-88aa-4c26-b55d-fd6432d1e680 on hv-cinder-84599 Aug 01 14:22:56.691348 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-f31beada-4649-42df-8f27-aefb613df1d1 req-a0a20d9e-8ef1-4312-94d9-1464cfe5d3c2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049663 Aug 01 14:22:56.692064 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 184/365] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:22:56.767767 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1c43890a-3381-4e9c-b384-93753d58442f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:56.768711 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-1c43890a-3381-4e9c-b384-93753d58442f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:56.776628 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1c43890a-3381-4e9c-b384-93753d58442f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:56.777377 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1c43890a-3381-4e9c-b384-93753d58442f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:56.778269 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1c43890a-3381-4e9c-b384-93753d58442f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:56.778930 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1c43890a-3381-4e9c-b384-93753d58442f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:56.803417 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:56.893249 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1c43890a-3381-4e9c-b384-93753d58442f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:56.903700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-1c43890a-3381-4e9c-b384-93753d58442f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1218 microversion: 2.1 time: 0.140571 Aug 01 14:22:56.904236 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 182/366] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:56 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1218 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:57.245382 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-03d61e03-6aa3-4df0-b194-1f5b783c076f tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:57.246065 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-03d61e03-6aa3-4df0-b194-1f5b783c076f tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:57.252977 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-03d61e03-6aa3-4df0-b194-1f5b783c076f tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:57.253426 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-03d61e03-6aa3-4df0-b194-1f5b783c076f tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:57.254187 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-03d61e03-6aa3-4df0-b194-1f5b783c076f tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:57.254614 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-03d61e03-6aa3-4df0-b194-1f5b783c076f tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:57.326921 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-03d61e03-6aa3-4df0-b194-1f5b783c076f tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:57.335002 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-03d61e03-6aa3-4df0-b194-1f5b783c076f tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1218 microversion: 2.1 time: 0.093956 Aug 01 14:22:57.335606 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 185/367] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:57 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:57.606399 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5b89288a-91eb-4f26-8aab-8cb755c83a16 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:57.607160 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5b89288a-91eb-4f26-8aab-8cb755c83a16 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:57.614438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5b89288a-91eb-4f26-8aab-8cb755c83a16 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:57.614879 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5b89288a-91eb-4f26-8aab-8cb755c83a16 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:57.615727 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5b89288a-91eb-4f26-8aab-8cb755c83a16 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:57.616245 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5b89288a-91eb-4f26-8aab-8cb755c83a16 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:57.619040 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-33039d06-3254-4c32-9c1b-f2920736daf0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:57.619928 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-33039d06-3254-4c32-9c1b-f2920736daf0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:57.626603 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-33039d06-3254-4c32-9c1b-f2920736daf0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:57.627053 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-33039d06-3254-4c32-9c1b-f2920736daf0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:57.628129 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-33039d06-3254-4c32-9c1b-f2920736daf0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:57.628567 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-33039d06-3254-4c32-9c1b-f2920736daf0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:57.772442 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-33039d06-3254-4c32-9c1b-f2920736daf0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:57.773333 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5b89288a-91eb-4f26-8aab-8cb755c83a16 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:57.780591 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-33039d06-3254-4c32-9c1b-f2920736daf0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:57.782166 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5b89288a-91eb-4f26-8aab-8cb755c83a16 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.179917 Aug 01 14:22:57.782730 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 183/368] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:57 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:57.782848 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-33039d06-3254-4c32-9c1b-f2920736daf0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:57.784197 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-33039d06-3254-4c32-9c1b-f2920736daf0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1722 microversion: 2.20 time: 0.172346 Aug 01 14:22:57.784582 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 186/369] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:57 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:22:57.926593 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0f846f1a-52cf-483a-85e9-a4de2bae3a5b tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:57.927202 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0f846f1a-52cf-483a-85e9-a4de2bae3a5b tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:57.933939 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0f846f1a-52cf-483a-85e9-a4de2bae3a5b tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:57.934286 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0f846f1a-52cf-483a-85e9-a4de2bae3a5b tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:57.935076 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0f846f1a-52cf-483a-85e9-a4de2bae3a5b tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:57.935546 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0f846f1a-52cf-483a-85e9-a4de2bae3a5b tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:58.011845 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0f846f1a-52cf-483a-85e9-a4de2bae3a5b tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:58.020348 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0f846f1a-52cf-483a-85e9-a4de2bae3a5b tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1218 microversion: 2.1 time: 0.097457 Aug 01 14:22:58.020940 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 184/370] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:57 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:58.356085 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a5a4de68-e382-4cb6-ba0b-a7d612b86874 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:58.356698 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a5a4de68-e382-4cb6-ba0b-a7d612b86874 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:58.364126 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a5a4de68-e382-4cb6-ba0b-a7d612b86874 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:58.364605 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a5a4de68-e382-4cb6-ba0b-a7d612b86874 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:58.365365 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a5a4de68-e382-4cb6-ba0b-a7d612b86874 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:58.365889 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a5a4de68-e382-4cb6-ba0b-a7d612b86874 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:58.433847 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a5a4de68-e382-4cb6-ba0b-a7d612b86874 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:58.441913 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a5a4de68-e382-4cb6-ba0b-a7d612b86874 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1218 microversion: 2.1 time: 0.089652 Aug 01 14:22:58.442854 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 187/371] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:58 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:58.803972 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-daf0e73c-d686-475d-a2ec-d5360db67481 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:58.805535 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-daf0e73c-d686-475d-a2ec-d5360db67481 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:58.808718 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e7735554-6240-440f-a554-beb30a752321 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:58.809932 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e7735554-6240-440f-a554-beb30a752321 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:58.812101 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-daf0e73c-d686-475d-a2ec-d5360db67481 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:58.813062 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-daf0e73c-d686-475d-a2ec-d5360db67481 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:58.813923 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-daf0e73c-d686-475d-a2ec-d5360db67481 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:58.814271 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-daf0e73c-d686-475d-a2ec-d5360db67481 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:58.819445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e7735554-6240-440f-a554-beb30a752321 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:58.819445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e7735554-6240-440f-a554-beb30a752321 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:58.819445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e7735554-6240-440f-a554-beb30a752321 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:58.820016 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e7735554-6240-440f-a554-beb30a752321 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:58.956556 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-daf0e73c-d686-475d-a2ec-d5360db67481 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:58.965843 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-daf0e73c-d686-475d-a2ec-d5360db67481 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1522 microversion: 2.1 time: 0.165925 Aug 01 14:22:58.966422 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 185/372] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:58 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:58.966976 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e7735554-6240-440f-a554-beb30a752321 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:58.976080 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e7735554-6240-440f-a554-beb30a752321 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:58.977966 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e7735554-6240-440f-a554-beb30a752321 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:58.979342 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e7735554-6240-440f-a554-beb30a752321 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1722 microversion: 2.20 time: 0.175225 Aug 01 14:22:58.979941 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 188/373] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:58 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:22:59.042312 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ac821ac2-8a21-47ce-b3e8-4bb478a23f7e tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:59.042919 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ac821ac2-8a21-47ce-b3e8-4bb478a23f7e tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:59.044803 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:59.050735 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ac821ac2-8a21-47ce-b3e8-4bb478a23f7e tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:59.051175 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ac821ac2-8a21-47ce-b3e8-4bb478a23f7e tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:59.051968 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ac821ac2-8a21-47ce-b3e8-4bb478a23f7e tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:59.052505 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ac821ac2-8a21-47ce-b3e8-4bb478a23f7e tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:59.121162 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ac821ac2-8a21-47ce-b3e8-4bb478a23f7e tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:59.129654 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ac821ac2-8a21-47ce-b3e8-4bb478a23f7e tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1218 microversion: 2.1 time: 0.091043 Aug 01 14:22:59.130236 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 186/374] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:59 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:59.465625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-11de8fb3-30cf-40d8-be06-4dbe098e5ae1 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:59.466286 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-11de8fb3-30cf-40d8-be06-4dbe098e5ae1 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:59.478891 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-11de8fb3-30cf-40d8-be06-4dbe098e5ae1 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:59.479346 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-11de8fb3-30cf-40d8-be06-4dbe098e5ae1 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:59.482600 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-11de8fb3-30cf-40d8-be06-4dbe098e5ae1 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:59.483099 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-11de8fb3-30cf-40d8-be06-4dbe098e5ae1 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:59.606571 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-11de8fb3-30cf-40d8-be06-4dbe098e5ae1 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:59.623547 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-11de8fb3-30cf-40d8-be06-4dbe098e5ae1 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1218 microversion: 2.1 time: 0.160681 Aug 01 14:22:59.624163 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 189/375] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:59 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1218 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:59.781942 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9ca49e9b-b111-4294-867c-98c1575ba389 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1557845599", "imageRef": "9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1", "flavorRef": "452", "networks": [{"uuid": "1b803e73-7491-4f9c-b808-c7c452f92be3"}]}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:59.838695 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.network.neutron [None req-9ca49e9b-b111-4294-867c-98c1575ba389 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] validate_networks() for [('1b803e73-7491-4f9c-b808-c7c452f92be3', None, None, None, None, None)] {{(pid=118132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:22:59.989276 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d7fc32bb-93ef-4eca-a638-fd2de6e43590 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:59.989882 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d7fc32bb-93ef-4eca-a638-fd2de6e43590 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:59.996894 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d7fc32bb-93ef-4eca-a638-fd2de6e43590 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:59.997713 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d7fc32bb-93ef-4eca-a638-fd2de6e43590 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:59.998495 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d7fc32bb-93ef-4eca-a638-fd2de6e43590 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:59.998934 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d7fc32bb-93ef-4eca-a638-fd2de6e43590 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:00.136229 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d7fc32bb-93ef-4eca-a638-fd2de6e43590 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:00.147997 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d7fc32bb-93ef-4eca-a638-fd2de6e43590 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1502 microversion: 2.1 time: 0.161546 Aug 01 14:23:00.148674 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 190/376] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:59 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:00.153973 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ed976636-f792-463e-ad5f-18162a00fa56 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:00.154567 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ed976636-f792-463e-ad5f-18162a00fa56 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:00.161548 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ed976636-f792-463e-ad5f-18162a00fa56 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:00.161986 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ed976636-f792-463e-ad5f-18162a00fa56 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:00.162750 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ed976636-f792-463e-ad5f-18162a00fa56 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:00.163175 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ed976636-f792-463e-ad5f-18162a00fa56 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:00.204671 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-9ca49e9b-b111-4294-867c-98c1575ba389 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Flavor limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:23:00.205088 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-9ca49e9b-b111-4294-867c-98c1575ba389 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Image limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:23:00.205562 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-9ca49e9b-b111-4294-867c-98c1575ba389 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Flavor pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:23:00.206011 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-9ca49e9b-b111-4294-867c-98c1575ba389 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Image pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:23:00.206421 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-9ca49e9b-b111-4294-867c-98c1575ba389 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:23:00.215368 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9ca49e9b-b111-4294-867c-98c1575ba389 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:00.215850 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9ca49e9b-b111-4294-867c-98c1575ba389 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:00.216654 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9ca49e9b-b111-4294-867c-98c1575ba389 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:00.217107 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9ca49e9b-b111-4294-867c-98c1575ba389 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:00.237446 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-9ca49e9b-b111-4294-867c-98c1575ba389 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Getting quotas for project 486a69a51709439aad36192aece6133e. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:23:00.241538 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-9ca49e9b-b111-4294-867c-98c1575ba389 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Getting quotas for user 0f6938e54a8d49a6b00d3a6694d4e57f and project 486a69a51709439aad36192aece6133e. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:23:00.253180 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9ca49e9b-b111-4294-867c-98c1575ba389 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Going to run 1 instances... {{(pid=118132) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:23:00.255312 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9ca49e9b-b111-4294-867c-98c1575ba389 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:23:00.302465 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ed976636-f792-463e-ad5f-18162a00fa56 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:00.306020 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9ca49e9b-b111-4294-867c-98c1575ba389 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528737 Aug 01 14:23:00.307030 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 187/377] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Aug 1 14:22:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:23:00.313626 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-662924bf-e1d5-4323-a70c-e9c4f6a4c871 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:00.314689 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-662924bf-e1d5-4323-a70c-e9c4f6a4c871 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:00.317723 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ed976636-f792-463e-ad5f-18162a00fa56 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:00.320190 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ed976636-f792-463e-ad5f-18162a00fa56 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:00.321391 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ed976636-f792-463e-ad5f-18162a00fa56 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1722 microversion: 2.20 time: 0.171515 Aug 01 14:23:00.321942 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 191/378] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:00 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:00.322091 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-662924bf-e1d5-4323-a70c-e9c4f6a4c871 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:00.322553 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-662924bf-e1d5-4323-a70c-e9c4f6a4c871 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:00.323342 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-662924bf-e1d5-4323-a70c-e9c4f6a4c871 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:00.323895 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-662924bf-e1d5-4323-a70c-e9c4f6a4c871 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:00.327629 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-555e0f23-9001-45f3-b5d9-ef54a5d7cc23 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:00.331393 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-555e0f23-9001-45f3-b5d9-ef54a5d7cc23 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:00.339772 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-555e0f23-9001-45f3-b5d9-ef54a5d7cc23 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:00.340497 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-555e0f23-9001-45f3-b5d9-ef54a5d7cc23 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:00.341931 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-555e0f23-9001-45f3-b5d9-ef54a5d7cc23 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:00.342954 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-555e0f23-9001-45f3-b5d9-ef54a5d7cc23 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:00.349408 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=100 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:00.413521 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-662924bf-e1d5-4323-a70c-e9c4f6a4c871 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:00.422519 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-662924bf-e1d5-4323-a70c-e9c4f6a4c871 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1266 microversion: 2.1 time: 0.113551 Aug 01 14:23:00.423490 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 188/379] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:00 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1266 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:00.428708 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-95098bfd-c6cf-468b-a285-d6fda3fbb9cf tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:00.429938 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-95098bfd-c6cf-468b-a285-d6fda3fbb9cf tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:00.489675 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-95098bfd-c6cf-468b-a285-d6fda3fbb9cf tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:00.496909 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-95098bfd-c6cf-468b-a285-d6fda3fbb9cf tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1219 microversion: 2.1 time: 0.071980 Aug 01 14:23:00.497267 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 189/380] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:00 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:00.499484 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-555e0f23-9001-45f3-b5d9-ef54a5d7cc23 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:00.508635 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-555e0f23-9001-45f3-b5d9-ef54a5d7cc23 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1516 microversion: 2.1 time: 0.185158 Aug 01 14:23:00.509226 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 192/381] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:00 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1516 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:00.652120 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3d34282f-6b2a-4b2f-a30e-8aa1077ff270 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:00.652948 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3d34282f-6b2a-4b2f-a30e-8aa1077ff270 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:00.669240 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3d34282f-6b2a-4b2f-a30e-8aa1077ff270 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:00.670092 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3d34282f-6b2a-4b2f-a30e-8aa1077ff270 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:00.672093 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3d34282f-6b2a-4b2f-a30e-8aa1077ff270 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:00.672756 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3d34282f-6b2a-4b2f-a30e-8aa1077ff270 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:00.757382 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3d34282f-6b2a-4b2f-a30e-8aa1077ff270 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:00.765869 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3d34282f-6b2a-4b2f-a30e-8aa1077ff270 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1266 microversion: 2.1 time: 0.118037 Aug 01 14:23:00.766573 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 190/382] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:00 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1266 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:01.344524 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9e60e76a-0ce0-4632-b77a-175b8a59835b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:01.345123 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9e60e76a-0ce0-4632-b77a-175b8a59835b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:01.348266 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:01.354514 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9e60e76a-0ce0-4632-b77a-175b8a59835b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:01.355033 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9e60e76a-0ce0-4632-b77a-175b8a59835b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:01.355900 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9e60e76a-0ce0-4632-b77a-175b8a59835b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:01.356333 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9e60e76a-0ce0-4632-b77a-175b8a59835b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:01.445006 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7468beb8-c230-4203-b9d8-95784a1f1e0c tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:01.445950 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7468beb8-c230-4203-b9d8-95784a1f1e0c tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:01.452738 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7468beb8-c230-4203-b9d8-95784a1f1e0c tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:01.453301 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7468beb8-c230-4203-b9d8-95784a1f1e0c tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:01.454309 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7468beb8-c230-4203-b9d8-95784a1f1e0c tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:01.454806 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7468beb8-c230-4203-b9d8-95784a1f1e0c tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:01.520118 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9e60e76a-0ce0-4632-b77a-175b8a59835b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:01.529954 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9e60e76a-0ce0-4632-b77a-175b8a59835b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:01.532247 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9e60e76a-0ce0-4632-b77a-175b8a59835b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:01.533551 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9e60e76a-0ce0-4632-b77a-175b8a59835b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1722 microversion: 2.20 time: 0.193002 Aug 01 14:23:01.534524 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 193/383] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:01 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:01.538077 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7468beb8-c230-4203-b9d8-95784a1f1e0c tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:01.539125 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-26b85e27-4285-4744-8150-d4c9defd56ab tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:01.539836 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-26b85e27-4285-4744-8150-d4c9defd56ab tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:01.548158 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-26b85e27-4285-4744-8150-d4c9defd56ab tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:01.548926 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-26b85e27-4285-4744-8150-d4c9defd56ab tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:01.549722 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-26b85e27-4285-4744-8150-d4c9defd56ab tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:01.550161 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-26b85e27-4285-4744-8150-d4c9defd56ab tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:01.551914 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7468beb8-c230-4203-b9d8-95784a1f1e0c tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1266 microversion: 2.1 time: 0.110463 Aug 01 14:23:01.552899 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 191/384] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:01 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1266 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:01.620552 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-26b85e27-4285-4744-8150-d4c9defd56ab tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:01.629236 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-26b85e27-4285-4744-8150-d4c9defd56ab tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1215 microversion: 2.1 time: 0.094007 Aug 01 14:23:01.630244 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 194/385] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:01 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1215 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:01.788111 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ff11188e-093b-44d6-bab2-17a2fe039b41 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:01.788623 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ff11188e-093b-44d6-bab2-17a2fe039b41 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:01.796516 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ff11188e-093b-44d6-bab2-17a2fe039b41 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:01.797781 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ff11188e-093b-44d6-bab2-17a2fe039b41 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:01.798566 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ff11188e-093b-44d6-bab2-17a2fe039b41 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:01.798995 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ff11188e-093b-44d6-bab2-17a2fe039b41 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:01.864431 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ff11188e-093b-44d6-bab2-17a2fe039b41 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:01.872087 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ff11188e-093b-44d6-bab2-17a2fe039b41 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1266 microversion: 2.1 time: 0.087809 Aug 01 14:23:01.872658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 192/386] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:01 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:01.976651 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-187ddf2e-65fa-432b-b737-3c0b57b6719e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:01.978928 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-187ddf2e-65fa-432b-b737-3c0b57b6719e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:01.985888 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-187ddf2e-65fa-432b-b737-3c0b57b6719e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:01.986329 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-187ddf2e-65fa-432b-b737-3c0b57b6719e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:01.987097 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-187ddf2e-65fa-432b-b737-3c0b57b6719e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:01.987557 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-187ddf2e-65fa-432b-b737-3c0b57b6719e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:02.012545 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-187ddf2e-65fa-432b-b737-3c0b57b6719e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lazy-loading 'flavor' on Instance uuid 2775d75f-b4fd-451b-bba5-471868aafc29 {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:23:02.099063 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-187ddf2e-65fa-432b-b737-3c0b57b6719e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "POST /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29/action" status: 200 len: 32 microversion: 2.1 time: 0.126365 Aug 01 14:23:02.099619 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 195/387] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Aug 1 14:23:01 2022] POST /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29/action => generated 32 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:23:02.114216 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6a209d67-7abb-4aeb-b61a-8a8bd916916b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:02.115878 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-6a209d67-7abb-4aeb-b61a-8a8bd916916b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:02.129467 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6a209d67-7abb-4aeb-b61a-8a8bd916916b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:02.130164 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6a209d67-7abb-4aeb-b61a-8a8bd916916b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:02.132479 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6a209d67-7abb-4aeb-b61a-8a8bd916916b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:02.134154 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6a209d67-7abb-4aeb-b61a-8a8bd916916b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:02.355373 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6a209d67-7abb-4aeb-b61a-8a8bd916916b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:02.368842 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6a209d67-7abb-4aeb-b61a-8a8bd916916b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.263146 Aug 01 14:23:02.372994 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 193/388] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:02 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:02.563618 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ef2f68f8-9c68-4476-8cc9-b929bf5ac231 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:02.565261 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ef2f68f8-9c68-4476-8cc9-b929bf5ac231 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:02.580549 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ef2f68f8-9c68-4476-8cc9-b929bf5ac231 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:02.581166 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ef2f68f8-9c68-4476-8cc9-b929bf5ac231 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:02.581969 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ef2f68f8-9c68-4476-8cc9-b929bf5ac231 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:02.582398 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ef2f68f8-9c68-4476-8cc9-b929bf5ac231 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:02.583064 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-98878160-290d-46af-a3c9-09e1abaebe5f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:02.584097 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-98878160-290d-46af-a3c9-09e1abaebe5f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:02.598693 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-98878160-290d-46af-a3c9-09e1abaebe5f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:02.599594 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-98878160-290d-46af-a3c9-09e1abaebe5f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:02.600866 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-98878160-290d-46af-a3c9-09e1abaebe5f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:02.601706 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-98878160-290d-46af-a3c9-09e1abaebe5f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:02.727262 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-98878160-290d-46af-a3c9-09e1abaebe5f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:02.742309 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-98878160-290d-46af-a3c9-09e1abaebe5f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1284 microversion: 2.1 time: 0.165366 Aug 01 14:23:02.744398 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 194/389] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:02 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:02.756151 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4bd3f4fc-b317-4106-a5ee-0908f8ede0b7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:02.757588 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4bd3f4fc-b317-4106-a5ee-0908f8ede0b7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:02.772472 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4bd3f4fc-b317-4106-a5ee-0908f8ede0b7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:02.773843 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4bd3f4fc-b317-4106-a5ee-0908f8ede0b7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:02.776015 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4bd3f4fc-b317-4106-a5ee-0908f8ede0b7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:02.777225 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4bd3f4fc-b317-4106-a5ee-0908f8ede0b7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:02.934059 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ef2f68f8-9c68-4476-8cc9-b929bf5ac231 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:02.946461 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ef2f68f8-9c68-4476-8cc9-b929bf5ac231 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:02.965740 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ef2f68f8-9c68-4476-8cc9-b929bf5ac231 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:02.972428 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ef2f68f8-9c68-4476-8cc9-b929bf5ac231 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1725 microversion: 2.20 time: 0.414925 Aug 01 14:23:02.975108 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 196/390] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:02 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1725 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:02.988923 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-2260351f-0a40-4c13-adaa-a01584b7ed1b tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:02.990367 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-2260351f-0a40-4c13-adaa-a01584b7ed1b tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:02.995634 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4bd3f4fc-b317-4106-a5ee-0908f8ede0b7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:03.008546 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2260351f-0a40-4c13-adaa-a01584b7ed1b tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:03.009006 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2260351f-0a40-4c13-adaa-a01584b7ed1b tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:03.009802 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2260351f-0a40-4c13-adaa-a01584b7ed1b tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:03.010240 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2260351f-0a40-4c13-adaa-a01584b7ed1b tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:03.028357 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4bd3f4fc-b317-4106-a5ee-0908f8ede0b7 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1271 microversion: 2.1 time: 0.277375 Aug 01 14:23:03.031379 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 195/391] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:02 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1271 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:03.067001 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-054482e4-804b-40d1-8eef-9dc9214e492e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c7dd47a-1e65-4efd-abab-263d8d2f9def"}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:03.082767 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-054482e4-804b-40d1-8eef-9dc9214e492e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:03.108517 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-054482e4-804b-40d1-8eef-9dc9214e492e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:03.112075 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-054482e4-804b-40d1-8eef-9dc9214e492e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:03.113321 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-054482e4-804b-40d1-8eef-9dc9214e492e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:03.116041 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-054482e4-804b-40d1-8eef-9dc9214e492e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:03.227904 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2260351f-0a40-4c13-adaa-a01584b7ed1b tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:03.249096 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-2260351f-0a40-4c13-adaa-a01584b7ed1b tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1272 microversion: 2.1 time: 0.269498 Aug 01 14:23:03.250290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 197/392] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:02 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1272 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:03.412786 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-10d036df-2fa6-4d1f-b7d2-4c0f2c1ccdd8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:03.413409 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-10d036df-2fa6-4d1f-b7d2-4c0f2c1ccdd8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:03.422134 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-10d036df-2fa6-4d1f-b7d2-4c0f2c1ccdd8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:03.422901 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-10d036df-2fa6-4d1f-b7d2-4c0f2c1ccdd8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:03.423741 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-10d036df-2fa6-4d1f-b7d2-4c0f2c1ccdd8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:03.424174 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-10d036df-2fa6-4d1f-b7d2-4c0f2c1ccdd8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:03.802083 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-054482e4-804b-40d1-8eef-9dc9214e492e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "POST /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.769011 Aug 01 14:23:03.803563 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 196/393] 10.222.0.17 () {62 vars in 1364 bytes} [Mon Aug 1 14:23:03 2022] POST /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680/os-volume_attachments => generated 188 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:23:03.808760 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a67c6aec-5dff-4908-9f41-d8fadd2d79af tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:03.809975 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a67c6aec-5dff-4908-9f41-d8fadd2d79af tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:03.819526 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a67c6aec-5dff-4908-9f41-d8fadd2d79af tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:03.821945 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a67c6aec-5dff-4908-9f41-d8fadd2d79af tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:03.822968 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a67c6aec-5dff-4908-9f41-d8fadd2d79af tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:03.823632 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a67c6aec-5dff-4908-9f41-d8fadd2d79af tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:03.907900 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-10d036df-2fa6-4d1f-b7d2-4c0f2c1ccdd8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:03.921837 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-10d036df-2fa6-4d1f-b7d2-4c0f2c1ccdd8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.512189 Aug 01 14:23:03.923450 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 198/394] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:03 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:03.945325 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a67c6aec-5dff-4908-9f41-d8fadd2d79af tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:03.958622 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a67c6aec-5dff-4908-9f41-d8fadd2d79af tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1272 microversion: 2.1 time: 0.153751 Aug 01 14:23:03.959626 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 197/395] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:03 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1272 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:03.967973 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-2abe1174-9dc0-4cb5-a36f-74a26f1eb9fc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:03.969131 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-2abe1174-9dc0-4cb5-a36f-74a26f1eb9fc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:03.976531 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2abe1174-9dc0-4cb5-a36f-74a26f1eb9fc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:03.977008 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2abe1174-9dc0-4cb5-a36f-74a26f1eb9fc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:03.978113 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2abe1174-9dc0-4cb5-a36f-74a26f1eb9fc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:03.979561 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2abe1174-9dc0-4cb5-a36f-74a26f1eb9fc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:04.044141 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-2abe1174-9dc0-4cb5-a36f-74a26f1eb9fc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118133) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 14:23:04.075580 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2c9c1822-a943-43d4-a5d1-2e895bc6dd4f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:04.080644 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2c9c1822-a943-43d4-a5d1-2e895bc6dd4f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:04.104261 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2c9c1822-a943-43d4-a5d1-2e895bc6dd4f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:04.109146 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2c9c1822-a943-43d4-a5d1-2e895bc6dd4f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:04.112149 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2c9c1822-a943-43d4-a5d1-2e895bc6dd4f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:04.116869 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2c9c1822-a943-43d4-a5d1-2e895bc6dd4f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:04.135435 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:04.221659 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-2abe1174-9dc0-4cb5-a36f-74a26f1eb9fc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "POST /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680/action" status: 202 len: 0 microversion: 2.20 time: 0.257180 Aug 01 14:23:04.230570 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 199/396] 10.222.0.17 () {62 vars in 1319 bytes} [Mon Aug 1 14:23:03 2022] POST /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:23:04.261396 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-af847ab1-807f-4ceb-8321-87353b33098d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:04.265790 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-af847ab1-807f-4ceb-8321-87353b33098d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:04.297388 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-af847ab1-807f-4ceb-8321-87353b33098d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:04.302636 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-af847ab1-807f-4ceb-8321-87353b33098d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:04.304051 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-af847ab1-807f-4ceb-8321-87353b33098d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:04.304723 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-af847ab1-807f-4ceb-8321-87353b33098d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:04.622991 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-af847ab1-807f-4ceb-8321-87353b33098d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:04.637314 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-af847ab1-807f-4ceb-8321-87353b33098d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:04.644221 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-af847ab1-807f-4ceb-8321-87353b33098d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:04.646555 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-af847ab1-807f-4ceb-8321-87353b33098d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1751 microversion: 2.20 time: 0.408760 Aug 01 14:23:04.648293 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 200/397] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:04 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1751 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:23:04.664549 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-868bbde4-3607-439d-9e04-714e73e7b162 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:04.666877 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-868bbde4-3607-439d-9e04-714e73e7b162 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:04.684443 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-868bbde4-3607-439d-9e04-714e73e7b162 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:04.685397 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-868bbde4-3607-439d-9e04-714e73e7b162 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:04.688631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-868bbde4-3607-439d-9e04-714e73e7b162 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:04.699978 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-868bbde4-3607-439d-9e04-714e73e7b162 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:05.000401 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-2c9c1822-a943-43d4-a5d1-2e895bc6dd4f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:05.020642 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2c9c1822-a943-43d4-a5d1-2e895bc6dd4f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1319 microversion: 2.1 time: 0.959273 Aug 01 14:23:05.021233 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 198/398] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:04 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1319 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:05.036118 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7f02218d-a39c-4f9f-bbea-f3cc275900b3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:05.036730 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7f02218d-a39c-4f9f-bbea-f3cc275900b3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:05.051280 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7f02218d-a39c-4f9f-bbea-f3cc275900b3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:05.051855 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7f02218d-a39c-4f9f-bbea-f3cc275900b3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:05.052690 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7f02218d-a39c-4f9f-bbea-f3cc275900b3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:05.053648 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7f02218d-a39c-4f9f-bbea-f3cc275900b3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:05.068947 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-868bbde4-3607-439d-9e04-714e73e7b162 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:05.077042 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-868bbde4-3607-439d-9e04-714e73e7b162 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1314 microversion: 2.1 time: 0.425377 Aug 01 14:23:05.078486 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 201/399] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:04 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:05.100512 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d4c893e0-2408-4c87-acd8-14b0dca50e07 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:05.102428 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d4c893e0-2408-4c87-acd8-14b0dca50e07 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:05.122794 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d4c893e0-2408-4c87-acd8-14b0dca50e07 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:05.123678 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d4c893e0-2408-4c87-acd8-14b0dca50e07 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:05.124923 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d4c893e0-2408-4c87-acd8-14b0dca50e07 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:05.125901 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d4c893e0-2408-4c87-acd8-14b0dca50e07 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:05.418439 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d4c893e0-2408-4c87-acd8-14b0dca50e07 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:05.434919 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d4c893e0-2408-4c87-acd8-14b0dca50e07 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1314 microversion: 2.1 time: 0.341083 Aug 01 14:23:05.434919 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 202/400] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:05 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:05.678279 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ab13a655-c4c1-46fe-8468-b94755e30063 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:05.679894 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ab13a655-c4c1-46fe-8468-b94755e30063 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:05.683228 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:05.693801 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ab13a655-c4c1-46fe-8468-b94755e30063 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:05.694688 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ab13a655-c4c1-46fe-8468-b94755e30063 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:05.696756 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ab13a655-c4c1-46fe-8468-b94755e30063 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:05.697502 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ab13a655-c4c1-46fe-8468-b94755e30063 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:05.704122 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7f02218d-a39c-4f9f-bbea-f3cc275900b3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:05.714076 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7f02218d-a39c-4f9f-bbea-f3cc275900b3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.691684 Aug 01 14:23:05.715331 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 199/401] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:05 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:05.751011 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=8 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:06.011316 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ab13a655-c4c1-46fe-8468-b94755e30063 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:06.021164 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ab13a655-c4c1-46fe-8468-b94755e30063 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:06.022692 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ab13a655-c4c1-46fe-8468-b94755e30063 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:06.028236 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ab13a655-c4c1-46fe-8468-b94755e30063 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1751 microversion: 2.20 time: 0.351489 Aug 01 14:23:06.028811 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 203/402] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:05 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1751 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:06.050469 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-65e6e211-030f-475a-b42f-0b3d7235c321 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:06.053234 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-65e6e211-030f-475a-b42f-0b3d7235c321 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:06.081375 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-65e6e211-030f-475a-b42f-0b3d7235c321 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:06.085009 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-65e6e211-030f-475a-b42f-0b3d7235c321 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:06.087698 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-65e6e211-030f-475a-b42f-0b3d7235c321 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:06.088628 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-65e6e211-030f-475a-b42f-0b3d7235c321 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:06.102749 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-2728a346-ebb7-4f8a-985e-107570560c9c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:06.103482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-2728a346-ebb7-4f8a-985e-107570560c9c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:06.118163 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2728a346-ebb7-4f8a-985e-107570560c9c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:06.123468 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2728a346-ebb7-4f8a-985e-107570560c9c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:06.126835 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2728a346-ebb7-4f8a-985e-107570560c9c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:06.135587 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2728a346-ebb7-4f8a-985e-107570560c9c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:06.438362 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2728a346-ebb7-4f8a-985e-107570560c9c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:06.451931 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-2728a346-ebb7-4f8a-985e-107570560c9c tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1314 microversion: 2.1 time: 0.354706 Aug 01 14:23:06.453049 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 204/403] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:06 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:06.481910 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-5b8f1119-479f-4e4b-a3b3-c1dc82341249 req-712da2ce-6b60-4c15-9506-9a8ed57f34e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f154e329-6643-4151-8508-5bf8d82bad04", "tag": "a0e1b0ef-e868-410c-9b5b-fad69afb99c2"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:06.496454 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-5b8f1119-479f-4e4b-a3b3-c1dc82341249 req-712da2ce-6b60-4c15-9506-9a8ed57f34e0 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:06.496924 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-5b8f1119-479f-4e4b-a3b3-c1dc82341249 req-712da2ce-6b60-4c15-9506-9a8ed57f34e0 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:06.514678 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-5b8f1119-479f-4e4b-a3b3-c1dc82341249 req-712da2ce-6b60-4c15-9506-9a8ed57f34e0 service nova] Creating event network-changed:a0e1b0ef-e868-410c-9b5b-fad69afb99c2 for instance f154e329-6643-4151-8508-5bf8d82bad04 on hv-cinder-84599 Aug 01 14:23:06.526078 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-5b8f1119-479f-4e4b-a3b3-c1dc82341249 req-712da2ce-6b60-4c15-9506-9a8ed57f34e0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051814 Aug 01 14:23:06.526821 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 205/404] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:23:06.540768 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-e23575e5-60af-4645-8e50-7d01f98d115f req-0e0e3a57-15a4-45b7-a806-f2b605324eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "547bd047-8f47-4a63-957d-f9883e499f1d", "tag": "f0f52d95-439d-46a4-9316-4599ac075066"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:06.555360 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-e23575e5-60af-4645-8e50-7d01f98d115f req-0e0e3a57-15a4-45b7-a806-f2b605324eb5 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:06.555917 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-e23575e5-60af-4645-8e50-7d01f98d115f req-0e0e3a57-15a4-45b7-a806-f2b605324eb5 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:06.572425 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-e23575e5-60af-4645-8e50-7d01f98d115f req-0e0e3a57-15a4-45b7-a806-f2b605324eb5 service nova] Creating event network-changed:f0f52d95-439d-46a4-9316-4599ac075066 for instance 547bd047-8f47-4a63-957d-f9883e499f1d on hv-cinder-84599 Aug 01 14:23:06.578238 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-e23575e5-60af-4645-8e50-7d01f98d115f req-0e0e3a57-15a4-45b7-a806-f2b605324eb5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049554 Aug 01 14:23:06.579090 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 206/405] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:23:06.585730 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-2f9a1fc3-88d3-4a93-b684-b5e7843aea95 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:06.586487 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-2f9a1fc3-88d3-4a93-b684-b5e7843aea95 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:06.613198 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2f9a1fc3-88d3-4a93-b684-b5e7843aea95 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:06.613662 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2f9a1fc3-88d3-4a93-b684-b5e7843aea95 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:06.614450 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2f9a1fc3-88d3-4a93-b684-b5e7843aea95 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:06.614890 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2f9a1fc3-88d3-4a93-b684-b5e7843aea95 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:06.631665 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:06.943483 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2f9a1fc3-88d3-4a93-b684-b5e7843aea95 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:06.956439 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-2f9a1fc3-88d3-4a93-b684-b5e7843aea95 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1314 microversion: 2.1 time: 0.374953 Aug 01 14:23:06.956439 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 207/406] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:06 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:06.961163 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-32b3dad7-344f-42a3-a02a-1f030d4cce1e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:06.961779 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-32b3dad7-344f-42a3-a02a-1f030d4cce1e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:06.968382 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-32b3dad7-344f-42a3-a02a-1f030d4cce1e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:06.968839 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-32b3dad7-344f-42a3-a02a-1f030d4cce1e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:06.978501 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-32b3dad7-344f-42a3-a02a-1f030d4cce1e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:06.979288 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-32b3dad7-344f-42a3-a02a-1f030d4cce1e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:07.052113 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-65e6e211-030f-475a-b42f-0b3d7235c321 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:07.061176 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-65e6e211-030f-475a-b42f-0b3d7235c321 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1319 microversion: 2.1 time: 1.019104 Aug 01 14:23:07.062915 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 200/407] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:06 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1319 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:07.068615 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3c69c5da-1982-4a8c-93cf-bac06ba74ce1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:07.069513 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3c69c5da-1982-4a8c-93cf-bac06ba74ce1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:07.076598 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3c69c5da-1982-4a8c-93cf-bac06ba74ce1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:07.077367 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3c69c5da-1982-4a8c-93cf-bac06ba74ce1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:07.078910 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3c69c5da-1982-4a8c-93cf-bac06ba74ce1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:07.079591 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3c69c5da-1982-4a8c-93cf-bac06ba74ce1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:07.456134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3c69c5da-1982-4a8c-93cf-bac06ba74ce1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:07.478424 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3c69c5da-1982-4a8c-93cf-bac06ba74ce1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:07.480135 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3c69c5da-1982-4a8c-93cf-bac06ba74ce1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:07.481413 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3c69c5da-1982-4a8c-93cf-bac06ba74ce1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1753 microversion: 2.20 time: 0.417210 Aug 01 14:23:07.488477 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 201/408] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:07 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1753 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:07.493584 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-fa63549d-7c30-46fd-86b1-9723a7b34aef tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:07.494446 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-fa63549d-7c30-46fd-86b1-9723a7b34aef tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:07.501278 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fa63549d-7c30-46fd-86b1-9723a7b34aef tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:07.502121 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fa63549d-7c30-46fd-86b1-9723a7b34aef tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:07.503113 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fa63549d-7c30-46fd-86b1-9723a7b34aef tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:07.503740 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fa63549d-7c30-46fd-86b1-9723a7b34aef tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:07.582343 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-32b3dad7-344f-42a3-a02a-1f030d4cce1e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:07.590245 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-32b3dad7-344f-42a3-a02a-1f030d4cce1e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.633350 Aug 01 14:23:07.590832 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 208/409] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:06 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:07.880497 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-fa63549d-7c30-46fd-86b1-9723a7b34aef tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:07.889175 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-fa63549d-7c30-46fd-86b1-9723a7b34aef tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1314 microversion: 2.1 time: 0.399354 Aug 01 14:23:07.889790 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 202/410] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:07 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:07.983260 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-088364fb-c521-4159-a6f0-1ae155b709c7 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:07.984045 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-088364fb-c521-4159-a6f0-1ae155b709c7 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:07.994364 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-088364fb-c521-4159-a6f0-1ae155b709c7 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:07.994364 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-088364fb-c521-4159-a6f0-1ae155b709c7 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:07.994641 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-088364fb-c521-4159-a6f0-1ae155b709c7 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:07.994930 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-088364fb-c521-4159-a6f0-1ae155b709c7 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:08.090349 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f3a7466a-4e52-405a-a573-f5d13b20ec35 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:08.090903 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f3a7466a-4e52-405a-a573-f5d13b20ec35 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:08.098102 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f3a7466a-4e52-405a-a573-f5d13b20ec35 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:08.098550 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f3a7466a-4e52-405a-a573-f5d13b20ec35 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:08.099314 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f3a7466a-4e52-405a-a573-f5d13b20ec35 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:08.099774 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f3a7466a-4e52-405a-a573-f5d13b20ec35 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:08.148017 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-088364fb-c521-4159-a6f0-1ae155b709c7 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:08.156003 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-088364fb-c521-4159-a6f0-1ae155b709c7 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1314 microversion: 2.1 time: 0.176809 Aug 01 14:23:08.161156 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 209/411] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:07 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:08.241437 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f3a7466a-4e52-405a-a573-f5d13b20ec35 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:08.250195 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f3a7466a-4e52-405a-a573-f5d13b20ec35 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1319 microversion: 2.1 time: 0.163744 Aug 01 14:23:08.251918 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 203/412] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:08 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:08.512378 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-23fc5e7e-f529-42b9-b01c-2e6c37893a39 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:08.512992 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-23fc5e7e-f529-42b9-b01c-2e6c37893a39 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:08.519947 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-23fc5e7e-f529-42b9-b01c-2e6c37893a39 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:08.520398 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-23fc5e7e-f529-42b9-b01c-2e6c37893a39 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:08.521178 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-23fc5e7e-f529-42b9-b01c-2e6c37893a39 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:08.521614 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-23fc5e7e-f529-42b9-b01c-2e6c37893a39 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:08.594014 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-1772876e-ef2e-4288-9d1d-7b5d0c6616ce req-5bc47d52-f966-4ea0-9a49-f0ff30c8536f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c8a6ff-979f-488e-8ea7-43158ba0570a", "tag": "3958ac7c-4615-4de4-ac54-06e8a6e50ac7"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:08.605721 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-1772876e-ef2e-4288-9d1d-7b5d0c6616ce req-5bc47d52-f966-4ea0-9a49-f0ff30c8536f service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:08.606238 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-1772876e-ef2e-4288-9d1d-7b5d0c6616ce req-5bc47d52-f966-4ea0-9a49-f0ff30c8536f service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:08.618670 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-1772876e-ef2e-4288-9d1d-7b5d0c6616ce req-5bc47d52-f966-4ea0-9a49-f0ff30c8536f service nova] Creating event network-changed:3958ac7c-4615-4de4-ac54-06e8a6e50ac7 for instance 99c8a6ff-979f-488e-8ea7-43158ba0570a on hv-cinder-84599 Aug 01 14:23:08.623992 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-1772876e-ef2e-4288-9d1d-7b5d0c6616ce req-5bc47d52-f966-4ea0-9a49-f0ff30c8536f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033571 Aug 01 14:23:08.625253 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 204/413] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:23:08.634631 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-764165c3-ba78-446c-bbe0-89776d29fd24 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:08.635327 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-764165c3-ba78-446c-bbe0-89776d29fd24 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:08.646766 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-764165c3-ba78-446c-bbe0-89776d29fd24 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:08.646766 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-764165c3-ba78-446c-bbe0-89776d29fd24 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:08.646766 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-764165c3-ba78-446c-bbe0-89776d29fd24 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:08.646766 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-764165c3-ba78-446c-bbe0-89776d29fd24 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:08.667057 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-23fc5e7e-f529-42b9-b01c-2e6c37893a39 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:08.676547 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-23fc5e7e-f529-42b9-b01c-2e6c37893a39 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:08.677790 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-23fc5e7e-f529-42b9-b01c-2e6c37893a39 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:08.679097 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-23fc5e7e-f529-42b9-b01c-2e6c37893a39 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1753 microversion: 2.20 time: 0.170635 Aug 01 14:23:08.679975 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 210/414] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:08 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:08.790203 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-764165c3-ba78-446c-bbe0-89776d29fd24 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:08.798459 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-764165c3-ba78-446c-bbe0-89776d29fd24 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.167943 Aug 01 14:23:08.799050 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 205/415] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:08 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:08.916345 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e8bd84b2-eaf9-48dc-acf0-783acacde039 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:08.917037 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e8bd84b2-eaf9-48dc-acf0-783acacde039 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:08.924233 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e8bd84b2-eaf9-48dc-acf0-783acacde039 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:08.924763 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e8bd84b2-eaf9-48dc-acf0-783acacde039 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:08.925539 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e8bd84b2-eaf9-48dc-acf0-783acacde039 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:08.925980 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e8bd84b2-eaf9-48dc-acf0-783acacde039 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:09.085912 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e8bd84b2-eaf9-48dc-acf0-783acacde039 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:09.094264 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e8bd84b2-eaf9-48dc-acf0-783acacde039 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1314 microversion: 2.1 time: 0.183303 Aug 01 14:23:09.095082 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 211/416] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:08 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:09.179282 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b8da660c-92ef-4ae0-a0a1-ba4205d13214 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:09.180588 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b8da660c-92ef-4ae0-a0a1-ba4205d13214 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:09.187798 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b8da660c-92ef-4ae0-a0a1-ba4205d13214 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:09.188288 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b8da660c-92ef-4ae0-a0a1-ba4205d13214 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:09.189994 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b8da660c-92ef-4ae0-a0a1-ba4205d13214 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:09.189994 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b8da660c-92ef-4ae0-a0a1-ba4205d13214 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:09.274349 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5ddc97ae-a1ec-476e-aa4c-0e32f6a63a38 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:09.274898 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5ddc97ae-a1ec-476e-aa4c-0e32f6a63a38 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:09.282359 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5ddc97ae-a1ec-476e-aa4c-0e32f6a63a38 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:09.282885 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5ddc97ae-a1ec-476e-aa4c-0e32f6a63a38 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:09.283815 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5ddc97ae-a1ec-476e-aa4c-0e32f6a63a38 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:09.284253 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5ddc97ae-a1ec-476e-aa4c-0e32f6a63a38 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:09.341102 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b8da660c-92ef-4ae0-a0a1-ba4205d13214 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:09.350440 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b8da660c-92ef-4ae0-a0a1-ba4205d13214 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1314 microversion: 2.1 time: 0.175553 Aug 01 14:23:09.351026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 206/417] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:09 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:09.429713 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5ddc97ae-a1ec-476e-aa4c-0e32f6a63a38 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:09.439270 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5ddc97ae-a1ec-476e-aa4c-0e32f6a63a38 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1319 microversion: 2.1 time: 0.168847 Aug 01 14:23:09.439892 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 212/418] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:09 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:09.703573 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-138e503b-18dc-4fb3-a231-b6ce1c7370b4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:09.704018 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-138e503b-18dc-4fb3-a231-b6ce1c7370b4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:09.710686 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-138e503b-18dc-4fb3-a231-b6ce1c7370b4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:09.711132 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-138e503b-18dc-4fb3-a231-b6ce1c7370b4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:09.711946 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-138e503b-18dc-4fb3-a231-b6ce1c7370b4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:09.712417 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-138e503b-18dc-4fb3-a231-b6ce1c7370b4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:09.819610 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5cbaddaf-e8f4-4afb-b27d-fe9370a8e9cf tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:09.820385 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5cbaddaf-e8f4-4afb-b27d-fe9370a8e9cf tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:09.826741 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5cbaddaf-e8f4-4afb-b27d-fe9370a8e9cf tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:09.827287 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5cbaddaf-e8f4-4afb-b27d-fe9370a8e9cf tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:09.828712 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5cbaddaf-e8f4-4afb-b27d-fe9370a8e9cf tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:09.829150 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5cbaddaf-e8f4-4afb-b27d-fe9370a8e9cf tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:09.854125 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-138e503b-18dc-4fb3-a231-b6ce1c7370b4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:09.863269 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-138e503b-18dc-4fb3-a231-b6ce1c7370b4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:09.864815 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-138e503b-18dc-4fb3-a231-b6ce1c7370b4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:09.866000 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-138e503b-18dc-4fb3-a231-b6ce1c7370b4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.167156 Aug 01 14:23:09.866564 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 207/419] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:09 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:09.974073 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5cbaddaf-e8f4-4afb-b27d-fe9370a8e9cf tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:09.983546 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5cbaddaf-e8f4-4afb-b27d-fe9370a8e9cf tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.167717 Aug 01 14:23:09.984168 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 213/420] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:09 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:10.116873 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b124452b-e3ff-4707-982e-a2b36bf52f52 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:10.117898 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b124452b-e3ff-4707-982e-a2b36bf52f52 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:10.125723 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b124452b-e3ff-4707-982e-a2b36bf52f52 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:10.126556 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b124452b-e3ff-4707-982e-a2b36bf52f52 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:10.127343 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b124452b-e3ff-4707-982e-a2b36bf52f52 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:10.128011 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b124452b-e3ff-4707-982e-a2b36bf52f52 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:10.225398 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=4 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:10.354533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b124452b-e3ff-4707-982e-a2b36bf52f52 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:10.365057 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b124452b-e3ff-4707-982e-a2b36bf52f52 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1314 microversion: 2.1 time: 0.252747 Aug 01 14:23:10.365651 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 208/421] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:10 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:10.375785 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d9999433-9eda-471a-bf52-5c48857994b7 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:10.376480 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d9999433-9eda-471a-bf52-5c48857994b7 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:10.383918 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d9999433-9eda-471a-bf52-5c48857994b7 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:10.384327 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d9999433-9eda-471a-bf52-5c48857994b7 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:10.385119 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d9999433-9eda-471a-bf52-5c48857994b7 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:10.385554 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d9999433-9eda-471a-bf52-5c48857994b7 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:10.462172 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-08fd4122-9430-4940-b31c-a88fa5ee6d4f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:10.464706 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-08fd4122-9430-4940-b31c-a88fa5ee6d4f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:10.472762 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-08fd4122-9430-4940-b31c-a88fa5ee6d4f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:10.473445 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-08fd4122-9430-4940-b31c-a88fa5ee6d4f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:10.474671 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-08fd4122-9430-4940-b31c-a88fa5ee6d4f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:10.475197 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-08fd4122-9430-4940-b31c-a88fa5ee6d4f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:10.496500 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=16 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:10.727258 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d9999433-9eda-471a-bf52-5c48857994b7 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:10.735867 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d9999433-9eda-471a-bf52-5c48857994b7 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1314 microversion: 2.1 time: 0.364424 Aug 01 14:23:10.737389 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 214/422] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:10 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:10.839017 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-08fd4122-9430-4940-b31c-a88fa5ee6d4f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:10.847973 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-08fd4122-9430-4940-b31c-a88fa5ee6d4f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1319 microversion: 2.1 time: 0.391002 Aug 01 14:23:10.848554 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 209/423] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:10 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1319 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:10.889942 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-27473dbb-0849-4fcf-b085-be9a4c0838e6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:10.890573 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-27473dbb-0849-4fcf-b085-be9a4c0838e6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:10.897014 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-27473dbb-0849-4fcf-b085-be9a4c0838e6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:10.897460 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-27473dbb-0849-4fcf-b085-be9a4c0838e6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:10.898228 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-27473dbb-0849-4fcf-b085-be9a4c0838e6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:10.898658 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-27473dbb-0849-4fcf-b085-be9a4c0838e6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:11.004384 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7b31da98-96a6-445e-b6c2-83a6c11e19e0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:11.004989 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7b31da98-96a6-445e-b6c2-83a6c11e19e0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:11.011073 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7b31da98-96a6-445e-b6c2-83a6c11e19e0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:11.011549 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7b31da98-96a6-445e-b6c2-83a6c11e19e0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:11.012323 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7b31da98-96a6-445e-b6c2-83a6c11e19e0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:11.012749 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7b31da98-96a6-445e-b6c2-83a6c11e19e0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:11.044173 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-27473dbb-0849-4fcf-b085-be9a4c0838e6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:11.053276 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-27473dbb-0849-4fcf-b085-be9a4c0838e6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:11.054802 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-27473dbb-0849-4fcf-b085-be9a4c0838e6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:11.056003 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-27473dbb-0849-4fcf-b085-be9a4c0838e6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.170080 Aug 01 14:23:11.056561 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 215/424] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:10 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:11.146941 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7b31da98-96a6-445e-b6c2-83a6c11e19e0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:11.154866 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7b31da98-96a6-445e-b6c2-83a6c11e19e0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.154290 Aug 01 14:23:11.155473 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 210/425] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:10 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:11.386920 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-35860a6d-047a-4b08-a54e-508ab39100b3 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:11.387631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-35860a6d-047a-4b08-a54e-508ab39100b3 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:11.395219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-35860a6d-047a-4b08-a54e-508ab39100b3 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:11.395697 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-35860a6d-047a-4b08-a54e-508ab39100b3 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:11.396478 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-35860a6d-047a-4b08-a54e-508ab39100b3 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:11.396910 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-35860a6d-047a-4b08-a54e-508ab39100b3 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:11.561342 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-35860a6d-047a-4b08-a54e-508ab39100b3 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:11.570233 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-35860a6d-047a-4b08-a54e-508ab39100b3 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1314 microversion: 2.1 time: 0.187087 Aug 01 14:23:11.570826 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 216/426] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:11 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:11.757872 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3dafa69a-2aa0-4da0-8770-1d12fab4b5f9 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:11.758526 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3dafa69a-2aa0-4da0-8770-1d12fab4b5f9 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:11.765766 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3dafa69a-2aa0-4da0-8770-1d12fab4b5f9 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:11.766227 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3dafa69a-2aa0-4da0-8770-1d12fab4b5f9 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:11.767142 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3dafa69a-2aa0-4da0-8770-1d12fab4b5f9 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:11.767436 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3dafa69a-2aa0-4da0-8770-1d12fab4b5f9 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:11.872703 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f1c170c2-f63c-4aff-9fe5-22e6b9e7f7e0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:11.874611 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f1c170c2-f63c-4aff-9fe5-22e6b9e7f7e0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:11.882596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f1c170c2-f63c-4aff-9fe5-22e6b9e7f7e0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:11.883689 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f1c170c2-f63c-4aff-9fe5-22e6b9e7f7e0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:11.884866 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f1c170c2-f63c-4aff-9fe5-22e6b9e7f7e0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:11.885345 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f1c170c2-f63c-4aff-9fe5-22e6b9e7f7e0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:12.083219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f1c170c2-f63c-4aff-9fe5-22e6b9e7f7e0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:12.093276 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f1c170c2-f63c-4aff-9fe5-22e6b9e7f7e0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1319 microversion: 2.1 time: 0.227038 Aug 01 14:23:12.094158 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 217/427] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:11 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:12.100037 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-20e8e2a3-f8ba-46f1-9a09-de9c2bed76f4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:12.100759 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-20e8e2a3-f8ba-46f1-9a09-de9c2bed76f4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:12.108621 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-20e8e2a3-f8ba-46f1-9a09-de9c2bed76f4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:12.109343 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-20e8e2a3-f8ba-46f1-9a09-de9c2bed76f4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:12.110338 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-20e8e2a3-f8ba-46f1-9a09-de9c2bed76f4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:12.111071 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-20e8e2a3-f8ba-46f1-9a09-de9c2bed76f4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:12.144084 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3dafa69a-2aa0-4da0-8770-1d12fab4b5f9 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:12.153356 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3dafa69a-2aa0-4da0-8770-1d12fab4b5f9 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1314 microversion: 2.1 time: 0.399621 Aug 01 14:23:12.153935 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 211/428] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:11 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:12.177042 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5b37276d-a4fd-4781-b51f-ee855c7dbded tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:12.177745 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5b37276d-a4fd-4781-b51f-ee855c7dbded tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:12.187487 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5b37276d-a4fd-4781-b51f-ee855c7dbded tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:12.188249 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5b37276d-a4fd-4781-b51f-ee855c7dbded tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:12.189425 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5b37276d-a4fd-4781-b51f-ee855c7dbded tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:12.190106 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5b37276d-a4fd-4781-b51f-ee855c7dbded tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:12.259919 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-20e8e2a3-f8ba-46f1-9a09-de9c2bed76f4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:12.271188 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-20e8e2a3-f8ba-46f1-9a09-de9c2bed76f4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:12.274505 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-20e8e2a3-f8ba-46f1-9a09-de9c2bed76f4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:12.275904 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-20e8e2a3-f8ba-46f1-9a09-de9c2bed76f4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.180501 Aug 01 14:23:12.276470 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 218/429] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:12 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:12.614411 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e5516faa-6419-414d-926f-06af26e04952 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:12.619622 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e5516faa-6419-414d-926f-06af26e04952 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:12.628319 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e5516faa-6419-414d-926f-06af26e04952 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:12.628992 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e5516faa-6419-414d-926f-06af26e04952 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:12.630202 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e5516faa-6419-414d-926f-06af26e04952 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:12.630827 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e5516faa-6419-414d-926f-06af26e04952 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:12.869046 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e5516faa-6419-414d-926f-06af26e04952 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:12.879961 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e5516faa-6419-414d-926f-06af26e04952 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1314 microversion: 2.1 time: 0.279231 Aug 01 14:23:12.890841 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 219/430] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:12 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:12.946545 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5b37276d-a4fd-4781-b51f-ee855c7dbded tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:12.956884 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5b37276d-a4fd-4781-b51f-ee855c7dbded tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.783842 Aug 01 14:23:12.972423 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 212/431] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:12 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:13.116878 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-504fb515-5498-4b19-aea5-a8b035ef7766 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:13.117533 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-504fb515-5498-4b19-aea5-a8b035ef7766 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:13.132014 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-504fb515-5498-4b19-aea5-a8b035ef7766 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:13.132543 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-504fb515-5498-4b19-aea5-a8b035ef7766 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:13.134833 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-504fb515-5498-4b19-aea5-a8b035ef7766 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:13.135279 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-504fb515-5498-4b19-aea5-a8b035ef7766 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:13.175898 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0cc3ae97-4c0f-4698-95cc-b229529d977c tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:13.176795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0cc3ae97-4c0f-4698-95cc-b229529d977c tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:13.191115 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0cc3ae97-4c0f-4698-95cc-b229529d977c tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:13.191621 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0cc3ae97-4c0f-4698-95cc-b229529d977c tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:13.193323 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0cc3ae97-4c0f-4698-95cc-b229529d977c tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:13.194153 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0cc3ae97-4c0f-4698-95cc-b229529d977c tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:13.318535 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-504fb515-5498-4b19-aea5-a8b035ef7766 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:13.331521 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-504fb515-5498-4b19-aea5-a8b035ef7766 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1319 microversion: 2.1 time: 0.218229 Aug 01 14:23:13.332196 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 220/432] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:13 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:13.338377 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-109f5d35-07c7-4b35-9ba0-fe95848c003b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:13.339574 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-109f5d35-07c7-4b35-9ba0-fe95848c003b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:13.348578 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-109f5d35-07c7-4b35-9ba0-fe95848c003b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:13.349159 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-109f5d35-07c7-4b35-9ba0-fe95848c003b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:13.350407 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-109f5d35-07c7-4b35-9ba0-fe95848c003b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:13.350852 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-109f5d35-07c7-4b35-9ba0-fe95848c003b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:13.549436 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0cc3ae97-4c0f-4698-95cc-b229529d977c tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:13.550609 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-109f5d35-07c7-4b35-9ba0-fe95848c003b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:13.558083 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0cc3ae97-4c0f-4698-95cc-b229529d977c tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1314 microversion: 2.1 time: 0.386919 Aug 01 14:23:13.559064 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 213/433] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:13 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:13.562461 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-109f5d35-07c7-4b35-9ba0-fe95848c003b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:13.563951 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-109f5d35-07c7-4b35-9ba0-fe95848c003b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:13.565704 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-109f5d35-07c7-4b35-9ba0-fe95848c003b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.231441 Aug 01 14:23:13.566793 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 221/434] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:13 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:13.912483 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7f4025ee-3103-4738-b092-16c2787a9adf tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:13.913241 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7f4025ee-3103-4738-b092-16c2787a9adf tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:13.920726 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7f4025ee-3103-4738-b092-16c2787a9adf tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:13.922011 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7f4025ee-3103-4738-b092-16c2787a9adf tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:13.922803 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7f4025ee-3103-4738-b092-16c2787a9adf tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:13.923238 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7f4025ee-3103-4738-b092-16c2787a9adf tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:13.982975 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7f0f352b-25bd-4488-acf1-7c4b3f05ba4c tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:13.984458 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7f0f352b-25bd-4488-acf1-7c4b3f05ba4c tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:13.998070 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7f0f352b-25bd-4488-acf1-7c4b3f05ba4c tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:13.999008 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7f0f352b-25bd-4488-acf1-7c4b3f05ba4c tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:14.000177 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7f0f352b-25bd-4488-acf1-7c4b3f05ba4c tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:14.001053 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7f0f352b-25bd-4488-acf1-7c4b3f05ba4c tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:14.150513 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7f4025ee-3103-4738-b092-16c2787a9adf tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:14.165805 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7f4025ee-3103-4738-b092-16c2787a9adf tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1314 microversion: 2.1 time: 0.258206 Aug 01 14:23:14.176207 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 214/435] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:13 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:14.228433 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7f0f352b-25bd-4488-acf1-7c4b3f05ba4c tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:14.238150 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7f0f352b-25bd-4488-acf1-7c4b3f05ba4c tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.263070 Aug 01 14:23:14.238771 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 222/436] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:13 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:14.358420 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-81541fbc-44ac-4acd-ac2b-eb091b834b70 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:14.359035 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-81541fbc-44ac-4acd-ac2b-eb091b834b70 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:14.365715 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-81541fbc-44ac-4acd-ac2b-eb091b834b70 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:14.366126 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-81541fbc-44ac-4acd-ac2b-eb091b834b70 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:14.366968 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-81541fbc-44ac-4acd-ac2b-eb091b834b70 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:14.367374 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-81541fbc-44ac-4acd-ac2b-eb091b834b70 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:14.391221 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=100 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:14.581191 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-42a3c66f-c877-44f5-81ce-5110babe653a tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:14.581829 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-42a3c66f-c877-44f5-81ce-5110babe653a tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:14.589457 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-42a3c66f-c877-44f5-81ce-5110babe653a tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:14.590039 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-42a3c66f-c877-44f5-81ce-5110babe653a tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:14.591011 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-42a3c66f-c877-44f5-81ce-5110babe653a tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:14.591575 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-42a3c66f-c877-44f5-81ce-5110babe653a tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:14.593338 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-81541fbc-44ac-4acd-ac2b-eb091b834b70 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:14.601928 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-81541fbc-44ac-4acd-ac2b-eb091b834b70 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1319 microversion: 2.1 time: 0.250609 Aug 01 14:23:14.602552 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 215/437] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:14 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:14.607711 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-72c3e1a2-1296-4df2-890e-fd2e1825517e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:14.607888 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-72c3e1a2-1296-4df2-890e-fd2e1825517e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:14.614527 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-72c3e1a2-1296-4df2-890e-fd2e1825517e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:14.614970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-72c3e1a2-1296-4df2-890e-fd2e1825517e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:14.615834 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-72c3e1a2-1296-4df2-890e-fd2e1825517e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:14.616325 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-72c3e1a2-1296-4df2-890e-fd2e1825517e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:14.747810 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-42a3c66f-c877-44f5-81ce-5110babe653a tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:14.752469 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=100 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:14.758174 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-42a3c66f-c877-44f5-81ce-5110babe653a tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1314 microversion: 2.1 time: 0.181493 Aug 01 14:23:14.758757 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 223/438] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:14 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:14.851967 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-72c3e1a2-1296-4df2-890e-fd2e1825517e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:14.862645 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-72c3e1a2-1296-4df2-890e-fd2e1825517e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:14.864756 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-72c3e1a2-1296-4df2-890e-fd2e1825517e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:14.866030 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-72c3e1a2-1296-4df2-890e-fd2e1825517e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.262540 Aug 01 14:23:14.866603 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 216/439] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:14 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:15.192824 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5e405cc2-cdd0-4698-8e19-4e0a8e79a2e3 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:15.193652 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5e405cc2-cdd0-4698-8e19-4e0a8e79a2e3 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:15.204380 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5e405cc2-cdd0-4698-8e19-4e0a8e79a2e3 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:15.205179 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5e405cc2-cdd0-4698-8e19-4e0a8e79a2e3 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:15.206625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5e405cc2-cdd0-4698-8e19-4e0a8e79a2e3 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:15.207706 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5e405cc2-cdd0-4698-8e19-4e0a8e79a2e3 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:15.260235 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3d442f24-e1ae-452f-a7fc-e586148d35f5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:15.261301 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3d442f24-e1ae-452f-a7fc-e586148d35f5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:15.274346 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3d442f24-e1ae-452f-a7fc-e586148d35f5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:15.275602 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3d442f24-e1ae-452f-a7fc-e586148d35f5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:15.277215 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3d442f24-e1ae-452f-a7fc-e586148d35f5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:15.278712 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3d442f24-e1ae-452f-a7fc-e586148d35f5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:15.432516 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5e405cc2-cdd0-4698-8e19-4e0a8e79a2e3 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:15.441302 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5e405cc2-cdd0-4698-8e19-4e0a8e79a2e3 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1314 microversion: 2.1 time: 0.254712 Aug 01 14:23:15.459223 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 224/440] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:15 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:15.494177 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3d442f24-e1ae-452f-a7fc-e586148d35f5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:15.503414 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3d442f24-e1ae-452f-a7fc-e586148d35f5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.247526 Aug 01 14:23:15.504447 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 217/441] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:15 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:15.623160 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-31df1457-ba23-48a5-a1eb-d954d5855792 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:15.624300 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-31df1457-ba23-48a5-a1eb-d954d5855792 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:15.631591 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-31df1457-ba23-48a5-a1eb-d954d5855792 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:15.632437 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-31df1457-ba23-48a5-a1eb-d954d5855792 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:15.633524 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-31df1457-ba23-48a5-a1eb-d954d5855792 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:15.634302 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-31df1457-ba23-48a5-a1eb-d954d5855792 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:15.788923 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7a3f4e27-d97b-4500-b865-563e1ba05c93 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:15.790435 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7a3f4e27-d97b-4500-b865-563e1ba05c93 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:15.802413 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7a3f4e27-d97b-4500-b865-563e1ba05c93 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:15.803816 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7a3f4e27-d97b-4500-b865-563e1ba05c93 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:15.805148 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7a3f4e27-d97b-4500-b865-563e1ba05c93 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:15.806179 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7a3f4e27-d97b-4500-b865-563e1ba05c93 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:15.923818 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-31df1457-ba23-48a5-a1eb-d954d5855792 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:15.933873 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-31df1457-ba23-48a5-a1eb-d954d5855792 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1319 microversion: 2.1 time: 0.314234 Aug 01 14:23:15.934100 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 225/442] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:15 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1319 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:15.951062 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-aa303650-8f74-4fc1-a983-8f1f0a612d9a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:15.953995 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-aa303650-8f74-4fc1-a983-8f1f0a612d9a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:15.968398 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa303650-8f74-4fc1-a983-8f1f0a612d9a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:15.969642 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa303650-8f74-4fc1-a983-8f1f0a612d9a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:15.972080 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa303650-8f74-4fc1-a983-8f1f0a612d9a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:15.972906 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa303650-8f74-4fc1-a983-8f1f0a612d9a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:16.047189 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7a3f4e27-d97b-4500-b865-563e1ba05c93 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:16.060382 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7a3f4e27-d97b-4500-b865-563e1ba05c93 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1314 microversion: 2.1 time: 0.282190 Aug 01 14:23:16.061253 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 218/443] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:15 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:16.117813 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-3fc61b33-1557-41cb-b1e2-b72e2e940615 req-73d608fc-3f5b-49d2-ac74-b56735742001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f154e329-6643-4151-8508-5bf8d82bad04", "name": "network-vif-plugged", "status": "completed", "tag": "a0e1b0ef-e868-410c-9b5b-fad69afb99c2"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:16.133759 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-3fc61b33-1557-41cb-b1e2-b72e2e940615 req-73d608fc-3f5b-49d2-ac74-b56735742001 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:16.138438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-3fc61b33-1557-41cb-b1e2-b72e2e940615 req-73d608fc-3f5b-49d2-ac74-b56735742001 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:16.167159 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-3fc61b33-1557-41cb-b1e2-b72e2e940615 req-73d608fc-3f5b-49d2-ac74-b56735742001 service nova] Creating event network-vif-plugged:a0e1b0ef-e868-410c-9b5b-fad69afb99c2 for instance f154e329-6643-4151-8508-5bf8d82bad04 on hv-cinder-84599 Aug 01 14:23:16.181315 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-3fc61b33-1557-41cb-b1e2-b72e2e940615 req-73d608fc-3f5b-49d2-ac74-b56735742001 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064984 Aug 01 14:23:16.182409 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 219/444] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:23:16.268839 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-aa303650-8f74-4fc1-a983-8f1f0a612d9a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:16.280145 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-aa303650-8f74-4fc1-a983-8f1f0a612d9a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:16.281875 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-aa303650-8f74-4fc1-a983-8f1f0a612d9a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:16.283250 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-aa303650-8f74-4fc1-a983-8f1f0a612d9a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.348149 Aug 01 14:23:16.286555 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 226/445] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:15 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:16.478811 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-eab97ad3-2b0a-4d33-a819-9d57989ed060 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:16.479890 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-eab97ad3-2b0a-4d33-a819-9d57989ed060 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:16.490511 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eab97ad3-2b0a-4d33-a819-9d57989ed060 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:16.491482 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eab97ad3-2b0a-4d33-a819-9d57989ed060 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:16.495150 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eab97ad3-2b0a-4d33-a819-9d57989ed060 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:16.495897 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eab97ad3-2b0a-4d33-a819-9d57989ed060 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:16.534325 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-744eb3c9-3ca3-45b4-bfb3-80b5fe1a0fda tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:16.535512 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-744eb3c9-3ca3-45b4-bfb3-80b5fe1a0fda tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:16.554160 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-744eb3c9-3ca3-45b4-bfb3-80b5fe1a0fda tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:16.555588 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-744eb3c9-3ca3-45b4-bfb3-80b5fe1a0fda tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:16.564616 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-744eb3c9-3ca3-45b4-bfb3-80b5fe1a0fda tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:16.566440 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-744eb3c9-3ca3-45b4-bfb3-80b5fe1a0fda tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:16.803903 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-eab97ad3-2b0a-4d33-a819-9d57989ed060 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:16.815319 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-eab97ad3-2b0a-4d33-a819-9d57989ed060 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1314 microversion: 2.1 time: 0.352464 Aug 01 14:23:16.816202 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 220/446] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:16 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:16.848945 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-744eb3c9-3ca3-45b4-bfb3-80b5fe1a0fda tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:16.857727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-744eb3c9-3ca3-45b4-bfb3-80b5fe1a0fda tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.330065 Aug 01 14:23:16.858321 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 227/447] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:16 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:16.956999 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-05982127-52d0-4c91-b904-aec32b832e7f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:16.958113 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-05982127-52d0-4c91-b904-aec32b832e7f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:16.966555 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05982127-52d0-4c91-b904-aec32b832e7f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:16.967112 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05982127-52d0-4c91-b904-aec32b832e7f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:16.968636 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05982127-52d0-4c91-b904-aec32b832e7f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:16.969151 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05982127-52d0-4c91-b904-aec32b832e7f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:17.086663 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-74d56445-15aa-4445-a20a-6e24a4675438 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:17.087605 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-74d56445-15aa-4445-a20a-6e24a4675438 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:17.098582 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-74d56445-15aa-4445-a20a-6e24a4675438 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:17.099338 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-74d56445-15aa-4445-a20a-6e24a4675438 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:17.101119 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-74d56445-15aa-4445-a20a-6e24a4675438 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:17.102075 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-74d56445-15aa-4445-a20a-6e24a4675438 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:17.164201 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-05982127-52d0-4c91-b904-aec32b832e7f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:17.178278 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-05982127-52d0-4c91-b904-aec32b832e7f tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1319 microversion: 2.1 time: 0.225397 Aug 01 14:23:17.179334 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 221/448] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:16 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:17.314838 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-74d56445-15aa-4445-a20a-6e24a4675438 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:17.316965 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-59fe2fca-d04e-4537-ba56-b7afe211897c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:17.317654 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-59fe2fca-d04e-4537-ba56-b7afe211897c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:17.324536 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-59fe2fca-d04e-4537-ba56-b7afe211897c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:17.324877 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-59fe2fca-d04e-4537-ba56-b7afe211897c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:17.325614 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-59fe2fca-d04e-4537-ba56-b7afe211897c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:17.326048 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-59fe2fca-d04e-4537-ba56-b7afe211897c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:17.327138 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-74d56445-15aa-4445-a20a-6e24a4675438 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1314 microversion: 2.1 time: 0.245436 Aug 01 14:23:17.336783 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 228/449] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:17 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:17.502648 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-59fe2fca-d04e-4537-ba56-b7afe211897c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:17.512695 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-59fe2fca-d04e-4537-ba56-b7afe211897c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:17.514619 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-59fe2fca-d04e-4537-ba56-b7afe211897c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:17.518559 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-59fe2fca-d04e-4537-ba56-b7afe211897c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.203744 Aug 01 14:23:17.524127 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 222/450] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:17 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:17.845936 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ea31e13b-9310-4df5-a8af-2f25a27b12f2 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:17.846756 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ea31e13b-9310-4df5-a8af-2f25a27b12f2 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:17.854603 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ea31e13b-9310-4df5-a8af-2f25a27b12f2 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:17.855094 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ea31e13b-9310-4df5-a8af-2f25a27b12f2 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:17.855935 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ea31e13b-9310-4df5-a8af-2f25a27b12f2 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:17.858032 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ea31e13b-9310-4df5-a8af-2f25a27b12f2 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:17.881053 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-52f2b8d9-a6d4-4ebf-bd0b-3c2af8cd928b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:17.881918 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-52f2b8d9-a6d4-4ebf-bd0b-3c2af8cd928b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:17.891881 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-52f2b8d9-a6d4-4ebf-bd0b-3c2af8cd928b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:17.892336 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-52f2b8d9-a6d4-4ebf-bd0b-3c2af8cd928b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:17.893122 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-52f2b8d9-a6d4-4ebf-bd0b-3c2af8cd928b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:17.893562 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-52f2b8d9-a6d4-4ebf-bd0b-3c2af8cd928b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:18.046466 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-52f2b8d9-a6d4-4ebf-bd0b-3c2af8cd928b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:18.059035 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-52f2b8d9-a6d4-4ebf-bd0b-3c2af8cd928b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.181800 Aug 01 14:23:18.059799 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 223/451] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:17 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:18.076539 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ea31e13b-9310-4df5-a8af-2f25a27b12f2 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:18.085285 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ea31e13b-9310-4df5-a8af-2f25a27b12f2 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1314 microversion: 2.1 time: 0.244055 Aug 01 14:23:18.085884 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 229/452] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:17 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:18.217126 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-cf015623-54c0-4b6c-b1a9-5a4e1a376c6e tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:18.218407 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-cf015623-54c0-4b6c-b1a9-5a4e1a376c6e tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:18.220091 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-9fd4a421-952f-47d7-9066-d21df82b7586 req-1a856595-bcee-4dc4-ab87-b994f4a91c67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "547bd047-8f47-4a63-957d-f9883e499f1d", "name": "network-vif-plugged", "status": "completed", "tag": "f0f52d95-439d-46a4-9316-4599ac075066"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:18.225455 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cf015623-54c0-4b6c-b1a9-5a4e1a376c6e tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:18.225922 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cf015623-54c0-4b6c-b1a9-5a4e1a376c6e tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:18.227138 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cf015623-54c0-4b6c-b1a9-5a4e1a376c6e tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:18.227330 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cf015623-54c0-4b6c-b1a9-5a4e1a376c6e tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:18.230848 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-9fd4a421-952f-47d7-9066-d21df82b7586 req-1a856595-bcee-4dc4-ab87-b994f4a91c67 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:18.231325 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-9fd4a421-952f-47d7-9066-d21df82b7586 req-1a856595-bcee-4dc4-ab87-b994f4a91c67 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:18.243860 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-9fd4a421-952f-47d7-9066-d21df82b7586 req-1a856595-bcee-4dc4-ab87-b994f4a91c67 service nova] Creating event network-vif-plugged:f0f52d95-439d-46a4-9316-4599ac075066 for instance 547bd047-8f47-4a63-957d-f9883e499f1d on hv-cinder-84599 Aug 01 14:23:18.252536 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-9fd4a421-952f-47d7-9066-d21df82b7586 req-1a856595-bcee-4dc4-ab87-b994f4a91c67 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034747 Aug 01 14:23:18.253783 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 230/453] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:23:18.359299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-45fe2698-c4d5-4be0-a2c7-864763c41de4 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:18.360063 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-45fe2698-c4d5-4be0-a2c7-864763c41de4 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:18.370624 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-45fe2698-c4d5-4be0-a2c7-864763c41de4 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:18.374917 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-45fe2698-c4d5-4be0-a2c7-864763c41de4 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:18.377056 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-45fe2698-c4d5-4be0-a2c7-864763c41de4 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:18.378056 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-45fe2698-c4d5-4be0-a2c7-864763c41de4 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:18.442514 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-cf015623-54c0-4b6c-b1a9-5a4e1a376c6e tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:18.451677 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-cf015623-54c0-4b6c-b1a9-5a4e1a376c6e tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1319 microversion: 2.1 time: 0.238274 Aug 01 14:23:18.453585 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 224/454] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:18 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:18.541203 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d58dd0c5-673b-4568-966d-409e87f1600d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:18.543130 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d58dd0c5-673b-4568-966d-409e87f1600d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:18.555509 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d58dd0c5-673b-4568-966d-409e87f1600d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:18.556109 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-45fe2698-c4d5-4be0-a2c7-864763c41de4 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:18.556301 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d58dd0c5-673b-4568-966d-409e87f1600d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:18.557511 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d58dd0c5-673b-4568-966d-409e87f1600d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:18.557780 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d58dd0c5-673b-4568-966d-409e87f1600d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:18.564785 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-45fe2698-c4d5-4be0-a2c7-864763c41de4 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1314 microversion: 2.1 time: 0.210502 Aug 01 14:23:18.565715 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 231/455] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:18 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:18.717116 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d58dd0c5-673b-4568-966d-409e87f1600d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:18.726818 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d58dd0c5-673b-4568-966d-409e87f1600d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:18.728345 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d58dd0c5-673b-4568-966d-409e87f1600d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:18.729509 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d58dd0c5-673b-4568-966d-409e87f1600d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.192270 Aug 01 14:23:18.730083 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 225/456] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:18 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:23:19.081071 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b9914670-843a-4dd2-942d-7cd5fcadc732 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:19.081729 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b9914670-843a-4dd2-942d-7cd5fcadc732 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:19.088357 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b9914670-843a-4dd2-942d-7cd5fcadc732 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:19.088803 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b9914670-843a-4dd2-942d-7cd5fcadc732 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:19.089574 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b9914670-843a-4dd2-942d-7cd5fcadc732 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:19.090082 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b9914670-843a-4dd2-942d-7cd5fcadc732 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:19.109637 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-466ef016-d27b-486c-b802-2beecbb46566 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:19.110571 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-466ef016-d27b-486c-b802-2beecbb46566 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:19.118792 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-466ef016-d27b-486c-b802-2beecbb46566 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:19.119560 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-466ef016-d27b-486c-b802-2beecbb46566 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:19.120364 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-466ef016-d27b-486c-b802-2beecbb46566 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:19.120842 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-466ef016-d27b-486c-b802-2beecbb46566 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:19.312549 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b9914670-843a-4dd2-942d-7cd5fcadc732 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:19.322065 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b9914670-843a-4dd2-942d-7cd5fcadc732 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.245340 Aug 01 14:23:19.323273 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 232/457] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:19 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:19.339499 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-466ef016-d27b-486c-b802-2beecbb46566 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:19.348769 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-466ef016-d27b-486c-b802-2beecbb46566 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1314 microversion: 2.1 time: 0.244656 Aug 01 14:23:19.361435 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 226/458] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:19 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:19.474385 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7be44641-35e0-4de8-a277-aa43adf2747e tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:19.475265 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7be44641-35e0-4de8-a277-aa43adf2747e tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:19.482225 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7be44641-35e0-4de8-a277-aa43adf2747e tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:19.482670 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7be44641-35e0-4de8-a277-aa43adf2747e tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:19.484210 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7be44641-35e0-4de8-a277-aa43adf2747e tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:19.484540 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7be44641-35e0-4de8-a277-aa43adf2747e tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:19.587818 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-72eeaca7-b9a4-4504-ba76-dd3970908dac tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:19.589700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-72eeaca7-b9a4-4504-ba76-dd3970908dac tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:19.598583 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-72eeaca7-b9a4-4504-ba76-dd3970908dac tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:19.599032 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-72eeaca7-b9a4-4504-ba76-dd3970908dac tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:19.599978 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-72eeaca7-b9a4-4504-ba76-dd3970908dac tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:19.600730 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-72eeaca7-b9a4-4504-ba76-dd3970908dac tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:19.673647 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7be44641-35e0-4de8-a277-aa43adf2747e tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:19.682182 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7be44641-35e0-4de8-a277-aa43adf2747e tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1319 microversion: 2.1 time: 0.212228 Aug 01 14:23:19.699791 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 233/459] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:19 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:19.753657 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-72e3df61-ff9b-4497-a424-8a734dae55cd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:19.754274 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-72e3df61-ff9b-4497-a424-8a734dae55cd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:19.761096 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-72e3df61-ff9b-4497-a424-8a734dae55cd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:19.761535 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-72e3df61-ff9b-4497-a424-8a734dae55cd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:19.762332 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-72e3df61-ff9b-4497-a424-8a734dae55cd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:19.762770 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-72e3df61-ff9b-4497-a424-8a734dae55cd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:19.838614 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-72eeaca7-b9a4-4504-ba76-dd3970908dac tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:19.858933 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-72eeaca7-b9a4-4504-ba76-dd3970908dac tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1314 microversion: 2.1 time: 0.274324 Aug 01 14:23:19.872037 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 227/460] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:19 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:19.994343 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-72e3df61-ff9b-4497-a424-8a734dae55cd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:20.005420 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-72e3df61-ff9b-4497-a424-8a734dae55cd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:20.007573 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-72e3df61-ff9b-4497-a424-8a734dae55cd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:20.008957 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-72e3df61-ff9b-4497-a424-8a734dae55cd tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.259465 Aug 01 14:23:20.009904 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 234/461] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:19 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:23:20.350766 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3753e86a-865c-400c-a2b3-208e0cb11b55 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:20.352256 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3753e86a-865c-400c-a2b3-208e0cb11b55 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:20.356064 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:20.366798 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3753e86a-865c-400c-a2b3-208e0cb11b55 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:20.367604 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3753e86a-865c-400c-a2b3-208e0cb11b55 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:20.369000 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3753e86a-865c-400c-a2b3-208e0cb11b55 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:20.369605 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3753e86a-865c-400c-a2b3-208e0cb11b55 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:20.376187 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ea7a9cef-1420-4cba-8684-f94e1d1e8b72 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:20.377866 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ea7a9cef-1420-4cba-8684-f94e1d1e8b72 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:20.386859 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ea7a9cef-1420-4cba-8684-f94e1d1e8b72 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:20.387766 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ea7a9cef-1420-4cba-8684-f94e1d1e8b72 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:20.388699 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ea7a9cef-1420-4cba-8684-f94e1d1e8b72 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:20.389235 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ea7a9cef-1420-4cba-8684-f94e1d1e8b72 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:20.560070 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3753e86a-865c-400c-a2b3-208e0cb11b55 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:20.576607 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3753e86a-865c-400c-a2b3-208e0cb11b55 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.233141 Aug 01 14:23:20.578145 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 228/462] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:20 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:20.586688 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ea7a9cef-1420-4cba-8684-f94e1d1e8b72 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:20.598652 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ea7a9cef-1420-4cba-8684-f94e1d1e8b72 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1314 microversion: 2.1 time: 0.227498 Aug 01 14:23:20.599713 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 235/463] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:20 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:20.714738 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-195161c1-ead0-446a-b138-f1b72a8f2969 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:20.715345 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-195161c1-ead0-446a-b138-f1b72a8f2969 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:20.724243 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-195161c1-ead0-446a-b138-f1b72a8f2969 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:20.724579 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-195161c1-ead0-446a-b138-f1b72a8f2969 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:20.725257 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-195161c1-ead0-446a-b138-f1b72a8f2969 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:20.725942 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-195161c1-ead0-446a-b138-f1b72a8f2969 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:20.883705 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5fa567e2-a47b-47f5-a61e-264fd7183071 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:20.884485 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5fa567e2-a47b-47f5-a61e-264fd7183071 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:20.892717 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5fa567e2-a47b-47f5-a61e-264fd7183071 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:20.893225 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5fa567e2-a47b-47f5-a61e-264fd7183071 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:20.894036 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5fa567e2-a47b-47f5-a61e-264fd7183071 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:20.894584 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5fa567e2-a47b-47f5-a61e-264fd7183071 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:20.936215 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-195161c1-ead0-446a-b138-f1b72a8f2969 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:20.946169 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-195161c1-ead0-446a-b138-f1b72a8f2969 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1319 microversion: 2.1 time: 0.235408 Aug 01 14:23:20.947064 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 229/464] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:20 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:21.036292 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4c568900-a0a7-481f-8fee-e437019b9a39 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:21.036917 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4c568900-a0a7-481f-8fee-e437019b9a39 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:21.043407 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4c568900-a0a7-481f-8fee-e437019b9a39 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:21.043892 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4c568900-a0a7-481f-8fee-e437019b9a39 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:21.044718 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4c568900-a0a7-481f-8fee-e437019b9a39 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:21.045156 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4c568900-a0a7-481f-8fee-e437019b9a39 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:21.119429 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5fa567e2-a47b-47f5-a61e-264fd7183071 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:21.130503 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5fa567e2-a47b-47f5-a61e-264fd7183071 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1314 microversion: 2.1 time: 0.251964 Aug 01 14:23:21.131255 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 236/465] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:20 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:21.239012 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4c568900-a0a7-481f-8fee-e437019b9a39 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:21.248625 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4c568900-a0a7-481f-8fee-e437019b9a39 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:21.250282 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4c568900-a0a7-481f-8fee-e437019b9a39 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:21.251745 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4c568900-a0a7-481f-8fee-e437019b9a39 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.219985 Aug 01 14:23:21.252463 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 230/466] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:21 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:21.608580 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7ee81c93-4369-4891-8e72-417da50aa0c9 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:21.609679 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7ee81c93-4369-4891-8e72-417da50aa0c9 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:21.619709 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7ee81c93-4369-4891-8e72-417da50aa0c9 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:21.620654 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7ee81c93-4369-4891-8e72-417da50aa0c9 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:21.622213 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7ee81c93-4369-4891-8e72-417da50aa0c9 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:21.623070 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7ee81c93-4369-4891-8e72-417da50aa0c9 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:21.623528 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-21f79930-95a6-4e80-8b24-3ae576d9cc0b tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:21.624611 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-21f79930-95a6-4e80-8b24-3ae576d9cc0b tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:21.633729 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-21f79930-95a6-4e80-8b24-3ae576d9cc0b tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:21.634202 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-21f79930-95a6-4e80-8b24-3ae576d9cc0b tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:21.634985 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-21f79930-95a6-4e80-8b24-3ae576d9cc0b tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:21.635420 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-21f79930-95a6-4e80-8b24-3ae576d9cc0b tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:21.826869 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7ee81c93-4369-4891-8e72-417da50aa0c9 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:21.839172 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-21f79930-95a6-4e80-8b24-3ae576d9cc0b tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:21.839816 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7ee81c93-4369-4891-8e72-417da50aa0c9 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.237850 Aug 01 14:23:21.843111 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 237/467] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:21 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:21.848359 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-21f79930-95a6-4e80-8b24-3ae576d9cc0b tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1314 microversion: 2.1 time: 0.228779 Aug 01 14:23:21.848975 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 231/468] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:21 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:21.976633 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d76e6278-09ec-4fae-af26-95ac6acf5a04 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:21.977500 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d76e6278-09ec-4fae-af26-95ac6acf5a04 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:21.984516 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d76e6278-09ec-4fae-af26-95ac6acf5a04 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:21.984969 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d76e6278-09ec-4fae-af26-95ac6acf5a04 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:21.985837 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d76e6278-09ec-4fae-af26-95ac6acf5a04 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:21.986275 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d76e6278-09ec-4fae-af26-95ac6acf5a04 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:22.153114 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-64de7c8d-2b91-40d0-b74b-fe5c163f48b1 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:22.153730 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-64de7c8d-2b91-40d0-b74b-fe5c163f48b1 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:22.160550 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-64de7c8d-2b91-40d0-b74b-fe5c163f48b1 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:22.161157 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-64de7c8d-2b91-40d0-b74b-fe5c163f48b1 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:22.162114 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-64de7c8d-2b91-40d0-b74b-fe5c163f48b1 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:22.162791 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-64de7c8d-2b91-40d0-b74b-fe5c163f48b1 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:22.175959 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d76e6278-09ec-4fae-af26-95ac6acf5a04 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:22.187375 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d76e6278-09ec-4fae-af26-95ac6acf5a04 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1319 microversion: 2.1 time: 0.214138 Aug 01 14:23:22.188156 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 238/469] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:21 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:22.284003 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-65546ae2-b3bd-4802-86ab-80a98fde04e3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:22.284646 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-65546ae2-b3bd-4802-86ab-80a98fde04e3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:22.293429 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-65546ae2-b3bd-4802-86ab-80a98fde04e3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:22.293983 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-65546ae2-b3bd-4802-86ab-80a98fde04e3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:22.294947 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-65546ae2-b3bd-4802-86ab-80a98fde04e3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:22.295394 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-65546ae2-b3bd-4802-86ab-80a98fde04e3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:22.390893 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-64de7c8d-2b91-40d0-b74b-fe5c163f48b1 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:22.398064 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=100 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:22.411449 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-64de7c8d-2b91-40d0-b74b-fe5c163f48b1 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1314 microversion: 2.1 time: 0.262420 Aug 01 14:23:22.412606 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 232/470] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:22 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:22.579760 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-65546ae2-b3bd-4802-86ab-80a98fde04e3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:22.589512 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-65546ae2-b3bd-4802-86ab-80a98fde04e3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:22.597334 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-2db2c6bb-3707-4e0c-927f-0fb4d03837ff req-8fd4b6f7-4909-4855-a372-9b3638c89b09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c8a6ff-979f-488e-8ea7-43158ba0570a", "name": "network-vif-plugged", "status": "completed", "tag": "3958ac7c-4615-4de4-ac54-06e8a6e50ac7"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:22.602827 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-65546ae2-b3bd-4802-86ab-80a98fde04e3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:22.604832 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-65546ae2-b3bd-4802-86ab-80a98fde04e3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.333592 Aug 01 14:23:22.619822 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 239/471] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:22 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:23:22.629481 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-2db2c6bb-3707-4e0c-927f-0fb4d03837ff req-8fd4b6f7-4909-4855-a372-9b3638c89b09 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:22.630007 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-2db2c6bb-3707-4e0c-927f-0fb4d03837ff req-8fd4b6f7-4909-4855-a372-9b3638c89b09 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:22.646959 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-2db2c6bb-3707-4e0c-927f-0fb4d03837ff req-8fd4b6f7-4909-4855-a372-9b3638c89b09 service nova] Creating event network-vif-plugged:3958ac7c-4615-4de4-ac54-06e8a6e50ac7 for instance 99c8a6ff-979f-488e-8ea7-43158ba0570a on hv-cinder-84599 Aug 01 14:23:22.653259 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-2db2c6bb-3707-4e0c-927f-0fb4d03837ff req-8fd4b6f7-4909-4855-a372-9b3638c89b09 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060560 Aug 01 14:23:22.654038 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 233/472] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:23:22.862397 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b0b4293f-94aa-4e1c-9a11-4984350ea2ff tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:22.865048 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b0b4293f-94aa-4e1c-9a11-4984350ea2ff tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:22.868801 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:22.874311 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b0b4293f-94aa-4e1c-9a11-4984350ea2ff tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:22.874866 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b0b4293f-94aa-4e1c-9a11-4984350ea2ff tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:22.875786 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b0b4293f-94aa-4e1c-9a11-4984350ea2ff tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:22.876390 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b0b4293f-94aa-4e1c-9a11-4984350ea2ff tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:22.876635 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ba0d42c6-de8b-48b2-b8f4-314676b5a2e4 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:22.877868 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ba0d42c6-de8b-48b2-b8f4-314676b5a2e4 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:22.890920 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ba0d42c6-de8b-48b2-b8f4-314676b5a2e4 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:22.891814 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ba0d42c6-de8b-48b2-b8f4-314676b5a2e4 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:22.893616 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ba0d42c6-de8b-48b2-b8f4-314676b5a2e4 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:22.895272 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ba0d42c6-de8b-48b2-b8f4-314676b5a2e4 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:23.083949 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b0b4293f-94aa-4e1c-9a11-4984350ea2ff tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:23.097676 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b0b4293f-94aa-4e1c-9a11-4984350ea2ff tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.239763 Aug 01 14:23:23.099522 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 240/473] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:22 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:23.135571 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ba0d42c6-de8b-48b2-b8f4-314676b5a2e4 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:23.145243 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ba0d42c6-de8b-48b2-b8f4-314676b5a2e4 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1314 microversion: 2.1 time: 0.277774 Aug 01 14:23:23.145935 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 234/474] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:22 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:23.215493 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-43b73172-5c6a-417d-aa4b-b0bd89eda995 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:23.216421 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-43b73172-5c6a-417d-aa4b-b0bd89eda995 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:23.224131 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-43b73172-5c6a-417d-aa4b-b0bd89eda995 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:23.224573 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-43b73172-5c6a-417d-aa4b-b0bd89eda995 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:23.225342 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-43b73172-5c6a-417d-aa4b-b0bd89eda995 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:23.225773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-43b73172-5c6a-417d-aa4b-b0bd89eda995 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:23.230391 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=100 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:23.387608 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-43b73172-5c6a-417d-aa4b-b0bd89eda995 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:23.396874 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-43b73172-5c6a-417d-aa4b-b0bd89eda995 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1319 microversion: 2.1 time: 0.186070 Aug 01 14:23:23.397620 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 241/475] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:23 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:23.441683 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-671ba382-ad6f-4c99-b49d-a4bef7ea338e tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:23.442298 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-671ba382-ad6f-4c99-b49d-a4bef7ea338e tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:23.448738 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-671ba382-ad6f-4c99-b49d-a4bef7ea338e tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:23.449156 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-671ba382-ad6f-4c99-b49d-a4bef7ea338e tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:23.449929 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-671ba382-ad6f-4c99-b49d-a4bef7ea338e tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:23.450351 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-671ba382-ad6f-4c99-b49d-a4bef7ea338e tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:23.634774 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-671ba382-ad6f-4c99-b49d-a4bef7ea338e tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:23.640075 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-74da859c-ef90-4ad6-8d5a-5e7c307969da tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:23.642008 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-74da859c-ef90-4ad6-8d5a-5e7c307969da tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:23.644111 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-671ba382-ad6f-4c99-b49d-a4bef7ea338e tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1314 microversion: 2.1 time: 0.206022 Aug 01 14:23:23.653020 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-74da859c-ef90-4ad6-8d5a-5e7c307969da tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:23.654199 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-74da859c-ef90-4ad6-8d5a-5e7c307969da tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:23.656079 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-74da859c-ef90-4ad6-8d5a-5e7c307969da tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:23.660427 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 235/476] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:23 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:23.669590 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-74da859c-ef90-4ad6-8d5a-5e7c307969da tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:23.867571 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-74da859c-ef90-4ad6-8d5a-5e7c307969da tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:23.885449 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-74da859c-ef90-4ad6-8d5a-5e7c307969da tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:23.888195 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-74da859c-ef90-4ad6-8d5a-5e7c307969da tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:23.890260 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-74da859c-ef90-4ad6-8d5a-5e7c307969da tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.258168 Aug 01 14:23:23.891009 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 242/477] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:23 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:24.122461 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8ab1aeef-386c-4202-a0d4-205ac43eff54 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:24.123102 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-8ab1aeef-386c-4202-a0d4-205ac43eff54 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:24.131197 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8ab1aeef-386c-4202-a0d4-205ac43eff54 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:24.131755 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8ab1aeef-386c-4202-a0d4-205ac43eff54 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:24.132588 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8ab1aeef-386c-4202-a0d4-205ac43eff54 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:24.133083 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8ab1aeef-386c-4202-a0d4-205ac43eff54 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:24.167575 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a4319ac0-49e4-41c2-8f45-5744dc2cd68e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:24.168252 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a4319ac0-49e4-41c2-8f45-5744dc2cd68e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:24.189495 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a4319ac0-49e4-41c2-8f45-5744dc2cd68e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:24.190265 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a4319ac0-49e4-41c2-8f45-5744dc2cd68e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:24.191431 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a4319ac0-49e4-41c2-8f45-5744dc2cd68e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:24.192043 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a4319ac0-49e4-41c2-8f45-5744dc2cd68e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:24.356890 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-8ab1aeef-386c-4202-a0d4-205ac43eff54 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:24.366096 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8ab1aeef-386c-4202-a0d4-205ac43eff54 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.247623 Aug 01 14:23:24.367373 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 236/478] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:24 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:24.423043 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1146e1bd-dbc7-440c-a0ec-509ec94f18b8 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:24.425189 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-1146e1bd-dbc7-440c-a0ec-509ec94f18b8 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:24.432696 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a4319ac0-49e4-41c2-8f45-5744dc2cd68e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:24.442439 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1146e1bd-dbc7-440c-a0ec-509ec94f18b8 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:24.442894 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1146e1bd-dbc7-440c-a0ec-509ec94f18b8 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:24.448030 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1146e1bd-dbc7-440c-a0ec-509ec94f18b8 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:24.448867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1146e1bd-dbc7-440c-a0ec-509ec94f18b8 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:24.449712 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a4319ac0-49e4-41c2-8f45-5744dc2cd68e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1314 microversion: 2.1 time: 0.284843 Aug 01 14:23:24.451220 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 243/479] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:24 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:24.672883 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3100f13d-afba-4ca7-8f02-254868b9593a tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:24.674422 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3100f13d-afba-4ca7-8f02-254868b9593a tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:24.677863 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1146e1bd-dbc7-440c-a0ec-509ec94f18b8 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:24.683502 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3100f13d-afba-4ca7-8f02-254868b9593a tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:24.683972 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3100f13d-afba-4ca7-8f02-254868b9593a tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:24.684847 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3100f13d-afba-4ca7-8f02-254868b9593a tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:24.685529 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3100f13d-afba-4ca7-8f02-254868b9593a tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:24.700571 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-1146e1bd-dbc7-440c-a0ec-509ec94f18b8 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1319 microversion: 2.1 time: 0.283948 Aug 01 14:23:24.702646 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 237/480] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:24 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:24.864709 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3100f13d-afba-4ca7-8f02-254868b9593a tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:24.876675 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3100f13d-afba-4ca7-8f02-254868b9593a tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1314 microversion: 2.1 time: 0.208904 Aug 01 14:23:24.877578 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 244/481] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:24 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:24.915091 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0479eb7a-9b6b-42f9-8590-9b3c02845fe6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:24.915903 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0479eb7a-9b6b-42f9-8590-9b3c02845fe6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:24.923349 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0479eb7a-9b6b-42f9-8590-9b3c02845fe6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:24.923822 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0479eb7a-9b6b-42f9-8590-9b3c02845fe6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:24.924694 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0479eb7a-9b6b-42f9-8590-9b3c02845fe6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:24.925079 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0479eb7a-9b6b-42f9-8590-9b3c02845fe6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:25.077084 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0479eb7a-9b6b-42f9-8590-9b3c02845fe6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:25.086856 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0479eb7a-9b6b-42f9-8590-9b3c02845fe6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:25.088371 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0479eb7a-9b6b-42f9-8590-9b3c02845fe6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:25.089531 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0479eb7a-9b6b-42f9-8590-9b3c02845fe6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.178579 Aug 01 14:23:25.090103 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 238/482] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:24 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:25.400133 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-208cb058-0f28-49c6-b999-8da616dc0936 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:25.400792 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-208cb058-0f28-49c6-b999-8da616dc0936 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:25.409018 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-208cb058-0f28-49c6-b999-8da616dc0936 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:25.409467 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-208cb058-0f28-49c6-b999-8da616dc0936 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:25.410261 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-208cb058-0f28-49c6-b999-8da616dc0936 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:25.410701 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-208cb058-0f28-49c6-b999-8da616dc0936 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:25.473150 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7101a153-cf92-4b23-bbf5-28e5b52a3664 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:25.473857 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7101a153-cf92-4b23-bbf5-28e5b52a3664 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:25.482079 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7101a153-cf92-4b23-bbf5-28e5b52a3664 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:25.482534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7101a153-cf92-4b23-bbf5-28e5b52a3664 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:25.483380 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7101a153-cf92-4b23-bbf5-28e5b52a3664 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:25.483876 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7101a153-cf92-4b23-bbf5-28e5b52a3664 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:25.563668 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-208cb058-0f28-49c6-b999-8da616dc0936 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:25.579509 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-208cb058-0f28-49c6-b999-8da616dc0936 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.184783 Aug 01 14:23:25.580411 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 245/483] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:25 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:25.654975 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7101a153-cf92-4b23-bbf5-28e5b52a3664 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:25.667226 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7101a153-cf92-4b23-bbf5-28e5b52a3664 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1314 microversion: 2.1 time: 0.196714 Aug 01 14:23:25.667226 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 239/484] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:25 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:25.723363 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-573a7bac-8c08-479b-a378-c2f1d0e24f8b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:25.724361 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-573a7bac-8c08-479b-a378-c2f1d0e24f8b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:25.734190 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-573a7bac-8c08-479b-a378-c2f1d0e24f8b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:25.734190 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-573a7bac-8c08-479b-a378-c2f1d0e24f8b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:25.734190 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-573a7bac-8c08-479b-a378-c2f1d0e24f8b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:25.734755 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-573a7bac-8c08-479b-a378-c2f1d0e24f8b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:25.888448 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-573a7bac-8c08-479b-a378-c2f1d0e24f8b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:25.897100 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-573a7bac-8c08-479b-a378-c2f1d0e24f8b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1319 microversion: 2.1 time: 0.178240 Aug 01 14:23:25.897678 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 246/485] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:25 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:25.897980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b9bea3bf-6501-4778-867b-0ae783674b0f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:25.898610 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b9bea3bf-6501-4778-867b-0ae783674b0f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:25.904925 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b9bea3bf-6501-4778-867b-0ae783674b0f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:25.905371 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b9bea3bf-6501-4778-867b-0ae783674b0f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:25.906161 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b9bea3bf-6501-4778-867b-0ae783674b0f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:25.906565 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b9bea3bf-6501-4778-867b-0ae783674b0f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:26.044864 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b9bea3bf-6501-4778-867b-0ae783674b0f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:26.053404 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b9bea3bf-6501-4778-867b-0ae783674b0f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1314 microversion: 2.1 time: 0.159218 Aug 01 14:23:26.054645 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 240/486] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:25 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:26.117037 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d2e4dc0c-5198-419a-8d86-b50cfbed7ca3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:26.117725 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d2e4dc0c-5198-419a-8d86-b50cfbed7ca3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:26.127221 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d2e4dc0c-5198-419a-8d86-b50cfbed7ca3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:26.127767 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d2e4dc0c-5198-419a-8d86-b50cfbed7ca3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:26.128632 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d2e4dc0c-5198-419a-8d86-b50cfbed7ca3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:26.129138 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d2e4dc0c-5198-419a-8d86-b50cfbed7ca3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:26.285475 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d2e4dc0c-5198-419a-8d86-b50cfbed7ca3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:26.295491 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d2e4dc0c-5198-419a-8d86-b50cfbed7ca3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:26.299409 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d2e4dc0c-5198-419a-8d86-b50cfbed7ca3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:26.301761 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d2e4dc0c-5198-419a-8d86-b50cfbed7ca3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.190833 Aug 01 14:23:26.302619 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 247/487] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:26 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:26.602948 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-732fd9f3-aeab-4a3f-ab4a-1ad3005879bd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:26.603375 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-732fd9f3-aeab-4a3f-ab4a-1ad3005879bd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:26.610870 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-732fd9f3-aeab-4a3f-ab4a-1ad3005879bd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:26.611324 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-732fd9f3-aeab-4a3f-ab4a-1ad3005879bd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:26.612147 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-732fd9f3-aeab-4a3f-ab4a-1ad3005879bd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:26.612578 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-732fd9f3-aeab-4a3f-ab4a-1ad3005879bd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:26.690837 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8416f279-402b-44e9-bfe9-aafb75be625e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:26.691574 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8416f279-402b-44e9-bfe9-aafb75be625e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:26.699832 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8416f279-402b-44e9-bfe9-aafb75be625e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:26.700053 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8416f279-402b-44e9-bfe9-aafb75be625e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:26.700953 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8416f279-402b-44e9-bfe9-aafb75be625e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:26.701422 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8416f279-402b-44e9-bfe9-aafb75be625e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:26.762211 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-732fd9f3-aeab-4a3f-ab4a-1ad3005879bd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:26.776874 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-732fd9f3-aeab-4a3f-ab4a-1ad3005879bd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.178010 Aug 01 14:23:26.777996 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 241/488] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:26 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:26.901543 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8416f279-402b-44e9-bfe9-aafb75be625e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:26.910129 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8416f279-402b-44e9-bfe9-aafb75be625e tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1314 microversion: 2.1 time: 0.227480 Aug 01 14:23:26.910709 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 248/489] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:26 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:26.918425 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-958c28ce-6a01-422f-9739-23fb206d824a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:26.919026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-958c28ce-6a01-422f-9739-23fb206d824a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:26.925414 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-958c28ce-6a01-422f-9739-23fb206d824a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:26.925860 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-958c28ce-6a01-422f-9739-23fb206d824a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:26.926621 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-958c28ce-6a01-422f-9739-23fb206d824a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:26.927046 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-958c28ce-6a01-422f-9739-23fb206d824a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:27.081613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-958c28ce-6a01-422f-9739-23fb206d824a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:27.081903 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e07d262b-61ed-4575-bac6-b258a4c96e36 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:27.083141 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e07d262b-61ed-4575-bac6-b258a4c96e36 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:27.089335 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-958c28ce-6a01-422f-9739-23fb206d824a tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1319 microversion: 2.1 time: 0.175063 Aug 01 14:23:27.089921 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 242/490] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:26 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:27.093350 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e07d262b-61ed-4575-bac6-b258a4c96e36 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:27.094237 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e07d262b-61ed-4575-bac6-b258a4c96e36 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:27.095830 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e07d262b-61ed-4575-bac6-b258a4c96e36 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:27.096361 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e07d262b-61ed-4575-bac6-b258a4c96e36 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:27.241471 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e07d262b-61ed-4575-bac6-b258a4c96e36 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:27.250521 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e07d262b-61ed-4575-bac6-b258a4c96e36 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1314 microversion: 2.1 time: 0.176631 Aug 01 14:23:27.251119 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 249/491] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:27 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:27.325519 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ef248497-6cf2-417d-a0eb-d4125875d6c4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:27.326178 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ef248497-6cf2-417d-a0eb-d4125875d6c4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:27.333016 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ef248497-6cf2-417d-a0eb-d4125875d6c4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:27.333485 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ef248497-6cf2-417d-a0eb-d4125875d6c4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:27.334261 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ef248497-6cf2-417d-a0eb-d4125875d6c4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:27.334697 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ef248497-6cf2-417d-a0eb-d4125875d6c4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:27.477343 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ef248497-6cf2-417d-a0eb-d4125875d6c4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:27.492218 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ef248497-6cf2-417d-a0eb-d4125875d6c4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:27.493776 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ef248497-6cf2-417d-a0eb-d4125875d6c4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:27.494991 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ef248497-6cf2-417d-a0eb-d4125875d6c4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.173403 Aug 01 14:23:27.495665 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 243/492] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:27 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:23:27.812872 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5eb84be6-acad-4b90-9ccc-6303def30e10 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:27.813538 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5eb84be6-acad-4b90-9ccc-6303def30e10 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:27.820358 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5eb84be6-acad-4b90-9ccc-6303def30e10 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:27.820814 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5eb84be6-acad-4b90-9ccc-6303def30e10 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:27.821596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5eb84be6-acad-4b90-9ccc-6303def30e10 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:27.822035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5eb84be6-acad-4b90-9ccc-6303def30e10 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:27.931026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-cb7a8ac2-d78c-4820-8e0a-ef3a9283012a tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:27.931841 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-cb7a8ac2-d78c-4820-8e0a-ef3a9283012a tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:27.938708 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cb7a8ac2-d78c-4820-8e0a-ef3a9283012a tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:27.939232 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cb7a8ac2-d78c-4820-8e0a-ef3a9283012a tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:27.940035 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cb7a8ac2-d78c-4820-8e0a-ef3a9283012a tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:27.940464 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cb7a8ac2-d78c-4820-8e0a-ef3a9283012a tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:27.966206 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5eb84be6-acad-4b90-9ccc-6303def30e10 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:27.974921 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5eb84be6-acad-4b90-9ccc-6303def30e10 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.165926 Aug 01 14:23:27.975947 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 250/493] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:27 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:28.098811 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-cb7a8ac2-d78c-4820-8e0a-ef3a9283012a tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:28.107174 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-cb7a8ac2-d78c-4820-8e0a-ef3a9283012a tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1314 microversion: 2.1 time: 0.179913 Aug 01 14:23:28.107851 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 244/494] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:27 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:28.111909 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-01b1b905-5213-42ba-b7e6-b1cba71bca04 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:28.112509 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-01b1b905-5213-42ba-b7e6-b1cba71bca04 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:28.119058 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-01b1b905-5213-42ba-b7e6-b1cba71bca04 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:28.119520 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-01b1b905-5213-42ba-b7e6-b1cba71bca04 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:28.120296 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-01b1b905-5213-42ba-b7e6-b1cba71bca04 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:28.120724 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-01b1b905-5213-42ba-b7e6-b1cba71bca04 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:28.274114 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-320a0aea-8fd4-4119-a13d-821bedf2cc44 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:28.276249 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-320a0aea-8fd4-4119-a13d-821bedf2cc44 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:28.285178 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-320a0aea-8fd4-4119-a13d-821bedf2cc44 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:28.285632 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-320a0aea-8fd4-4119-a13d-821bedf2cc44 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:28.286446 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-320a0aea-8fd4-4119-a13d-821bedf2cc44 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:28.286942 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-320a0aea-8fd4-4119-a13d-821bedf2cc44 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:28.293020 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-01b1b905-5213-42ba-b7e6-b1cba71bca04 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:28.311180 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-01b1b905-5213-42ba-b7e6-b1cba71bca04 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1319 microversion: 2.1 time: 0.204346 Aug 01 14:23:28.311822 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 251/495] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:28 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:28.465664 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-320a0aea-8fd4-4119-a13d-821bedf2cc44 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:28.475260 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-320a0aea-8fd4-4119-a13d-821bedf2cc44 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1314 microversion: 2.1 time: 0.205640 Aug 01 14:23:28.489569 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 245/496] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:28 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:28.522231 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-60d6d865-2577-46e1-91c1-e773c96b3a1e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:28.523316 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-60d6d865-2577-46e1-91c1-e773c96b3a1e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:28.535284 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-60d6d865-2577-46e1-91c1-e773c96b3a1e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:28.536145 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-60d6d865-2577-46e1-91c1-e773c96b3a1e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:28.537574 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-60d6d865-2577-46e1-91c1-e773c96b3a1e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:28.538364 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-60d6d865-2577-46e1-91c1-e773c96b3a1e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:28.678784 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-60d6d865-2577-46e1-91c1-e773c96b3a1e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:28.690796 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-60d6d865-2577-46e1-91c1-e773c96b3a1e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:28.692365 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-60d6d865-2577-46e1-91c1-e773c96b3a1e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:28.693590 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-60d6d865-2577-46e1-91c1-e773c96b3a1e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.177470 Aug 01 14:23:28.694257 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 252/497] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:28 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:28.996395 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-89e7de24-4592-492d-b46f-274d3a648251 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:28.997012 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-89e7de24-4592-492d-b46f-274d3a648251 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:29.004574 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-89e7de24-4592-492d-b46f-274d3a648251 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:29.005057 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-89e7de24-4592-492d-b46f-274d3a648251 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:29.005800 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-89e7de24-4592-492d-b46f-274d3a648251 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:29.006235 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-89e7de24-4592-492d-b46f-274d3a648251 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:29.133483 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3cc156af-dbf0-452f-af4d-18a3eeb1cbea tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:29.134411 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3cc156af-dbf0-452f-af4d-18a3eeb1cbea tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:29.141901 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3cc156af-dbf0-452f-af4d-18a3eeb1cbea tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:29.142291 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-89e7de24-4592-492d-b46f-274d3a648251 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:29.142427 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3cc156af-dbf0-452f-af4d-18a3eeb1cbea tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:29.143134 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3cc156af-dbf0-452f-af4d-18a3eeb1cbea tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:29.143640 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3cc156af-dbf0-452f-af4d-18a3eeb1cbea tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:29.150744 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-89e7de24-4592-492d-b46f-274d3a648251 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.158264 Aug 01 14:23:29.163490 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 246/498] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:28 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:29.296349 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3cc156af-dbf0-452f-af4d-18a3eeb1cbea tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:29.305577 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3cc156af-dbf0-452f-af4d-18a3eeb1cbea tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1314 microversion: 2.1 time: 0.177439 Aug 01 14:23:29.311433 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 253/499] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:29 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:29.333558 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-43c35fdb-62f0-4dd8-a4b9-3bed11e6b86c tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:29.334507 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-43c35fdb-62f0-4dd8-a4b9-3bed11e6b86c tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:29.340524 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-43c35fdb-62f0-4dd8-a4b9-3bed11e6b86c tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:29.341225 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-43c35fdb-62f0-4dd8-a4b9-3bed11e6b86c tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:29.342225 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-43c35fdb-62f0-4dd8-a4b9-3bed11e6b86c tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:29.343374 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-43c35fdb-62f0-4dd8-a4b9-3bed11e6b86c tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:29.479478 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-43c35fdb-62f0-4dd8-a4b9-3bed11e6b86c tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:29.487510 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-43c35fdb-62f0-4dd8-a4b9-3bed11e6b86c tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1319 microversion: 2.1 time: 0.157838 Aug 01 14:23:29.488075 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 247/500] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:29 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:29.498078 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b16667dd-bdfd-43af-9443-7429bd79cd6e tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:29.498798 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b16667dd-bdfd-43af-9443-7429bd79cd6e tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:29.506346 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b16667dd-bdfd-43af-9443-7429bd79cd6e tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:29.506887 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b16667dd-bdfd-43af-9443-7429bd79cd6e tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:29.507820 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b16667dd-bdfd-43af-9443-7429bd79cd6e tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:29.508314 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b16667dd-bdfd-43af-9443-7429bd79cd6e tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:29.651901 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b16667dd-bdfd-43af-9443-7429bd79cd6e tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:29.660035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b16667dd-bdfd-43af-9443-7429bd79cd6e tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1314 microversion: 2.1 time: 0.165708 Aug 01 14:23:29.660706 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 254/501] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:29 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:29.718053 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-76dba5de-507f-49d0-9319-03a1faf06611 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:29.718651 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-76dba5de-507f-49d0-9319-03a1faf06611 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:29.725038 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-76dba5de-507f-49d0-9319-03a1faf06611 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:29.725479 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-76dba5de-507f-49d0-9319-03a1faf06611 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:29.726219 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-76dba5de-507f-49d0-9319-03a1faf06611 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:29.726640 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-76dba5de-507f-49d0-9319-03a1faf06611 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:29.913979 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-76dba5de-507f-49d0-9319-03a1faf06611 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:29.923512 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-76dba5de-507f-49d0-9319-03a1faf06611 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:29.925048 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-76dba5de-507f-49d0-9319-03a1faf06611 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:29.927902 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-76dba5de-507f-49d0-9319-03a1faf06611 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.212774 Aug 01 14:23:29.927902 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 248/502] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:29 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:30.173129 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-18d2e4d2-e95f-48f0-a876-6f4f09a176b1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:30.173678 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-18d2e4d2-e95f-48f0-a876-6f4f09a176b1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:30.180155 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-18d2e4d2-e95f-48f0-a876-6f4f09a176b1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:30.180596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-18d2e4d2-e95f-48f0-a876-6f4f09a176b1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:30.181345 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-18d2e4d2-e95f-48f0-a876-6f4f09a176b1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:30.181769 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-18d2e4d2-e95f-48f0-a876-6f4f09a176b1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:30.316383 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-18d2e4d2-e95f-48f0-a876-6f4f09a176b1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:30.324519 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-18d2e4d2-e95f-48f0-a876-6f4f09a176b1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.155328 Aug 01 14:23:30.325088 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 255/503] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:30 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:30.326305 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-cd680699-923e-443a-8008-93301dd2bcf2 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:30.327536 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-cd680699-923e-443a-8008-93301dd2bcf2 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:30.334177 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cd680699-923e-443a-8008-93301dd2bcf2 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:30.334623 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cd680699-923e-443a-8008-93301dd2bcf2 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:30.335377 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cd680699-923e-443a-8008-93301dd2bcf2 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:30.335829 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cd680699-923e-443a-8008-93301dd2bcf2 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:30.468239 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-cd680699-923e-443a-8008-93301dd2bcf2 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:30.476161 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-cd680699-923e-443a-8008-93301dd2bcf2 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1314 microversion: 2.1 time: 0.153775 Aug 01 14:23:30.476729 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 249/504] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:30 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:30.508347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a8b73c83-cd13-41ad-ba5d-c630210408f9 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:30.508975 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a8b73c83-cd13-41ad-ba5d-c630210408f9 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:30.515201 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a8b73c83-cd13-41ad-ba5d-c630210408f9 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:30.515710 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a8b73c83-cd13-41ad-ba5d-c630210408f9 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:30.516486 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a8b73c83-cd13-41ad-ba5d-c630210408f9 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:30.516922 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a8b73c83-cd13-41ad-ba5d-c630210408f9 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:30.656303 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a8b73c83-cd13-41ad-ba5d-c630210408f9 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:30.664820 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a8b73c83-cd13-41ad-ba5d-c630210408f9 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1319 microversion: 2.1 time: 0.160243 Aug 01 14:23:30.665285 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 256/505] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:30 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:30.681552 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e52b137b-55af-4439-96c4-d31097eef7d5 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:30.682378 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e52b137b-55af-4439-96c4-d31097eef7d5 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:30.689135 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e52b137b-55af-4439-96c4-d31097eef7d5 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:30.689583 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e52b137b-55af-4439-96c4-d31097eef7d5 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:30.690349 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e52b137b-55af-4439-96c4-d31097eef7d5 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:30.690784 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e52b137b-55af-4439-96c4-d31097eef7d5 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:30.695723 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=100 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:30.827748 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e52b137b-55af-4439-96c4-d31097eef7d5 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:30.835976 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e52b137b-55af-4439-96c4-d31097eef7d5 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1314 microversion: 2.1 time: 0.158216 Aug 01 14:23:30.836924 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 250/506] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:30 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:30.950549 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f6bcda2e-12cb-4f27-93b5-63edef31895f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:30.951215 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f6bcda2e-12cb-4f27-93b5-63edef31895f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:30.957789 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f6bcda2e-12cb-4f27-93b5-63edef31895f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:30.958248 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f6bcda2e-12cb-4f27-93b5-63edef31895f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:30.959016 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f6bcda2e-12cb-4f27-93b5-63edef31895f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:30.959477 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f6bcda2e-12cb-4f27-93b5-63edef31895f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:31.093600 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f6bcda2e-12cb-4f27-93b5-63edef31895f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:31.098617 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=100 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:31.111009 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f6bcda2e-12cb-4f27-93b5-63edef31895f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:31.112569 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f6bcda2e-12cb-4f27-93b5-63edef31895f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:31.113794 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f6bcda2e-12cb-4f27-93b5-63edef31895f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.167725 Aug 01 14:23:31.114361 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 257/507] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:30 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:31.347097 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-aa50390d-9c12-47fd-854a-e90dfa8c8424 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:31.347793 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-aa50390d-9c12-47fd-854a-e90dfa8c8424 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:31.354991 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aa50390d-9c12-47fd-854a-e90dfa8c8424 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:31.355441 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aa50390d-9c12-47fd-854a-e90dfa8c8424 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:31.356272 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aa50390d-9c12-47fd-854a-e90dfa8c8424 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:31.356705 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-aa50390d-9c12-47fd-854a-e90dfa8c8424 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:31.495116 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-aa50390d-9c12-47fd-854a-e90dfa8c8424 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:31.498330 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-2e718dbb-0e2d-4604-a90d-9bdbd026c0e8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:31.498928 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-2e718dbb-0e2d-4604-a90d-9bdbd026c0e8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:31.503556 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-aa50390d-9c12-47fd-854a-e90dfa8c8424 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.161116 Aug 01 14:23:31.504396 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 251/508] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:31 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:31.505979 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2e718dbb-0e2d-4604-a90d-9bdbd026c0e8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:31.506440 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2e718dbb-0e2d-4604-a90d-9bdbd026c0e8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:31.507230 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2e718dbb-0e2d-4604-a90d-9bdbd026c0e8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:31.507727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2e718dbb-0e2d-4604-a90d-9bdbd026c0e8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:31.650370 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2e718dbb-0e2d-4604-a90d-9bdbd026c0e8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:31.658128 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-2e718dbb-0e2d-4604-a90d-9bdbd026c0e8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1314 microversion: 2.1 time: 0.163918 Aug 01 14:23:31.658713 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 258/509] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:31 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:31.685655 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9e4765c9-0f18-44d0-bc32-78b2f917f9d3 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:31.687053 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9e4765c9-0f18-44d0-bc32-78b2f917f9d3 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:31.692806 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9e4765c9-0f18-44d0-bc32-78b2f917f9d3 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:31.693244 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9e4765c9-0f18-44d0-bc32-78b2f917f9d3 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:31.693991 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9e4765c9-0f18-44d0-bc32-78b2f917f9d3 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:31.694416 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9e4765c9-0f18-44d0-bc32-78b2f917f9d3 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:31.830091 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9e4765c9-0f18-44d0-bc32-78b2f917f9d3 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:31.837585 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9e4765c9-0f18-44d0-bc32-78b2f917f9d3 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1319 microversion: 2.1 time: 0.155702 Aug 01 14:23:31.838159 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 252/510] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:31 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:31.858127 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b186a85e-adae-4380-b1b2-fec777cd707f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:31.859298 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b186a85e-adae-4380-b1b2-fec777cd707f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:31.865358 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b186a85e-adae-4380-b1b2-fec777cd707f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:31.865803 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b186a85e-adae-4380-b1b2-fec777cd707f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:31.866561 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b186a85e-adae-4380-b1b2-fec777cd707f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:31.866992 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b186a85e-adae-4380-b1b2-fec777cd707f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:32.001951 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b186a85e-adae-4380-b1b2-fec777cd707f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:32.009526 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b186a85e-adae-4380-b1b2-fec777cd707f tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1314 microversion: 2.1 time: 0.155353 Aug 01 14:23:32.010097 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 259/511] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:31 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:32.141302 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e489c0a3-045c-4f7a-83f6-158f2b3257df tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:32.141897 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e489c0a3-045c-4f7a-83f6-158f2b3257df tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:32.147911 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e489c0a3-045c-4f7a-83f6-158f2b3257df tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:32.148348 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e489c0a3-045c-4f7a-83f6-158f2b3257df tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:32.149095 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e489c0a3-045c-4f7a-83f6-158f2b3257df tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:32.149517 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e489c0a3-045c-4f7a-83f6-158f2b3257df tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:32.283284 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e489c0a3-045c-4f7a-83f6-158f2b3257df tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:32.292293 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e489c0a3-045c-4f7a-83f6-158f2b3257df tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:32.293792 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e489c0a3-045c-4f7a-83f6-158f2b3257df tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:32.294957 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e489c0a3-045c-4f7a-83f6-158f2b3257df tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.157780 Aug 01 14:23:32.295583 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 253/512] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:32 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:32.526916 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-150453d7-33de-4b67-93f5-84793bd53da2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:32.527660 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-150453d7-33de-4b67-93f5-84793bd53da2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:32.534903 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-150453d7-33de-4b67-93f5-84793bd53da2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:32.535358 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-150453d7-33de-4b67-93f5-84793bd53da2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:32.536359 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-150453d7-33de-4b67-93f5-84793bd53da2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:32.536791 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-150453d7-33de-4b67-93f5-84793bd53da2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:32.679199 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-150453d7-33de-4b67-93f5-84793bd53da2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:32.679500 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-eb188490-4558-4f56-acfa-c9afcb7b3f70 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:32.680110 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-eb188490-4558-4f56-acfa-c9afcb7b3f70 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:32.687207 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eb188490-4558-4f56-acfa-c9afcb7b3f70 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:32.687677 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eb188490-4558-4f56-acfa-c9afcb7b3f70 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:32.688443 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eb188490-4558-4f56-acfa-c9afcb7b3f70 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:32.688870 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eb188490-4558-4f56-acfa-c9afcb7b3f70 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:32.698477 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-150453d7-33de-4b67-93f5-84793bd53da2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.175259 Aug 01 14:23:32.699543 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 260/513] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:32 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:32.835294 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-eb188490-4558-4f56-acfa-c9afcb7b3f70 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:32.846327 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-eb188490-4558-4f56-acfa-c9afcb7b3f70 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1314 microversion: 2.1 time: 0.170796 Aug 01 14:23:32.846918 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 254/514] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:32 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:32.859325 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6b9236dd-a245-42a9-8a2e-1e80d9cbb334 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:32.861060 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-6b9236dd-a245-42a9-8a2e-1e80d9cbb334 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:32.870531 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6b9236dd-a245-42a9-8a2e-1e80d9cbb334 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:32.870769 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6b9236dd-a245-42a9-8a2e-1e80d9cbb334 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:32.871599 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6b9236dd-a245-42a9-8a2e-1e80d9cbb334 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:32.872031 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6b9236dd-a245-42a9-8a2e-1e80d9cbb334 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:33.030666 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6b9236dd-a245-42a9-8a2e-1e80d9cbb334 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:33.031283 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ab571680-e1bb-46fb-baea-2622ebdd136d tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:33.031941 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ab571680-e1bb-46fb-baea-2622ebdd136d tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:33.038143 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ab571680-e1bb-46fb-baea-2622ebdd136d tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:33.038865 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ab571680-e1bb-46fb-baea-2622ebdd136d tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:33.039071 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6b9236dd-a245-42a9-8a2e-1e80d9cbb334 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1319 microversion: 2.1 time: 0.184630 Aug 01 14:23:33.039686 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ab571680-e1bb-46fb-baea-2622ebdd136d tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:33.039824 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 261/515] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:32 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:33.043860 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ab571680-e1bb-46fb-baea-2622ebdd136d tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:33.192748 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ab571680-e1bb-46fb-baea-2622ebdd136d tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:33.201057 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ab571680-e1bb-46fb-baea-2622ebdd136d tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1464 microversion: 2.1 time: 0.174495 Aug 01 14:23:33.202832 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 255/516] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:33 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1464 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:33.256143 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-331e4198-aff9-4771-a533-01f644053699 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:33.256640 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-331e4198-aff9-4771-a533-01f644053699 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:33.263217 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-331e4198-aff9-4771-a533-01f644053699 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:33.263704 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-331e4198-aff9-4771-a533-01f644053699 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:33.265059 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-331e4198-aff9-4771-a533-01f644053699 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:33.265539 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-331e4198-aff9-4771-a533-01f644053699 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:33.291685 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-331e4198-aff9-4771-a533-01f644053699 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Going to try to terminate instance {{(pid=118133) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:23:33.320448 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-34281705-291f-44ea-8c95-23090ef66915 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:33.321165 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-34281705-291f-44ea-8c95-23090ef66915 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:33.327982 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-34281705-291f-44ea-8c95-23090ef66915 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:33.328427 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-34281705-291f-44ea-8c95-23090ef66915 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:33.329208 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-34281705-291f-44ea-8c95-23090ef66915 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:33.329730 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-34281705-291f-44ea-8c95-23090ef66915 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:33.387495 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-331e4198-aff9-4771-a533-01f644053699 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "DELETE /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 204 len: 0 microversion: 2.1 time: 0.135500 Aug 01 14:23:33.388314 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 262/517] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Aug 1 14:23:33 2022] DELETE /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:23:33.400195 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9bfffd6c-98d1-422f-978c-914099021493 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:33.400195 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9bfffd6c-98d1-422f-978c-914099021493 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:33.404659 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9bfffd6c-98d1-422f-978c-914099021493 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:33.405170 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9bfffd6c-98d1-422f-978c-914099021493 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:33.405958 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9bfffd6c-98d1-422f-978c-914099021493 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:33.406397 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9bfffd6c-98d1-422f-978c-914099021493 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:33.501024 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-34281705-291f-44ea-8c95-23090ef66915 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:33.510480 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-34281705-291f-44ea-8c95-23090ef66915 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:33.511800 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-34281705-291f-44ea-8c95-23090ef66915 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:33.513369 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-34281705-291f-44ea-8c95-23090ef66915 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.197423 Aug 01 14:23:33.517963 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 256/518] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:33 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:33.577584 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9bfffd6c-98d1-422f-978c-914099021493 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:33.585884 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9bfffd6c-98d1-422f-978c-914099021493 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1470 microversion: 2.1 time: 0.192476 Aug 01 14:23:33.586473 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 263/519] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:33 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1470 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:33.721967 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ecb24bde-8e65-4cc6-b36e-37a986ea5683 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:33.722582 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ecb24bde-8e65-4cc6-b36e-37a986ea5683 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:33.729592 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ecb24bde-8e65-4cc6-b36e-37a986ea5683 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:33.730043 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ecb24bde-8e65-4cc6-b36e-37a986ea5683 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:33.730820 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ecb24bde-8e65-4cc6-b36e-37a986ea5683 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:33.731253 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ecb24bde-8e65-4cc6-b36e-37a986ea5683 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:33.868321 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ecb24bde-8e65-4cc6-b36e-37a986ea5683 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:33.877505 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-1ae22e40-e76c-4dcc-be4d-73f6ecb48bb4 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:33.878878 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1ae22e40-e76c-4dcc-be4d-73f6ecb48bb4 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:33.881125 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ecb24bde-8e65-4cc6-b36e-37a986ea5683 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.161668 Aug 01 14:23:33.887109 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 257/520] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:33 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:33.890862 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1ae22e40-e76c-4dcc-be4d-73f6ecb48bb4 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:33.891756 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1ae22e40-e76c-4dcc-be4d-73f6ecb48bb4 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:33.893112 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1ae22e40-e76c-4dcc-be4d-73f6ecb48bb4 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:33.893900 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1ae22e40-e76c-4dcc-be4d-73f6ecb48bb4 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:34.060571 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1ae22e40-e76c-4dcc-be4d-73f6ecb48bb4 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:34.064751 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ec6ed8c3-1d70-4b3b-97ee-ab38672089c0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:34.066278 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ec6ed8c3-1d70-4b3b-97ee-ab38672089c0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:34.072091 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-1ae22e40-e76c-4dcc-be4d-73f6ecb48bb4 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1314 microversion: 2.1 time: 0.202428 Aug 01 14:23:34.072843 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 264/521] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:33 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:34.083851 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ec6ed8c3-1d70-4b3b-97ee-ab38672089c0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:34.084866 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ec6ed8c3-1d70-4b3b-97ee-ab38672089c0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:34.085674 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ec6ed8c3-1d70-4b3b-97ee-ab38672089c0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:34.086115 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ec6ed8c3-1d70-4b3b-97ee-ab38672089c0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:34.241801 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ec6ed8c3-1d70-4b3b-97ee-ab38672089c0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:34.252098 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ec6ed8c3-1d70-4b3b-97ee-ab38672089c0 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1507 microversion: 2.1 time: 0.194910 Aug 01 14:23:34.253060 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 258/522] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:34 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1507 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:34.273430 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7da40e9c-1e8a-4c61-b876-bf370fc5dad3 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96bb8d36-b49f-4195-911d-50a1b0349b9a", "device": "/dev/sdb"}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:34.275999 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7da40e9c-1e8a-4c61-b876-bf370fc5dad3 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:34.282631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7da40e9c-1e8a-4c61-b876-bf370fc5dad3 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:34.283189 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7da40e9c-1e8a-4c61-b876-bf370fc5dad3 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:34.283834 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7da40e9c-1e8a-4c61-b876-bf370fc5dad3 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:34.284266 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7da40e9c-1e8a-4c61-b876-bf370fc5dad3 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:34.537174 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a30c462d-5ead-4b27-b8cc-e5418630a01c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:34.537773 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a30c462d-5ead-4b27-b8cc-e5418630a01c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:34.545144 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a30c462d-5ead-4b27-b8cc-e5418630a01c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:34.546295 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a30c462d-5ead-4b27-b8cc-e5418630a01c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:34.547059 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a30c462d-5ead-4b27-b8cc-e5418630a01c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:34.547503 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a30c462d-5ead-4b27-b8cc-e5418630a01c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:34.716074 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a30c462d-5ead-4b27-b8cc-e5418630a01c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:34.725497 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a30c462d-5ead-4b27-b8cc-e5418630a01c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:34.727025 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a30c462d-5ead-4b27-b8cc-e5418630a01c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:34.728457 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a30c462d-5ead-4b27-b8cc-e5418630a01c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.195275 Aug 01 14:23:34.729047 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 259/523] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:34 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:23:34.734258 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4dc5ac98-7e88-4d1c-a26f-9789618862c2 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:34.734857 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4dc5ac98-7e88-4d1c-a26f-9789618862c2 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:34.741541 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4dc5ac98-7e88-4d1c-a26f-9789618862c2 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:34.741990 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4dc5ac98-7e88-4d1c-a26f-9789618862c2 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:34.742761 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4dc5ac98-7e88-4d1c-a26f-9789618862c2 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:34.743185 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4dc5ac98-7e88-4d1c-a26f-9789618862c2 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:34.886639 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4dc5ac98-7e88-4d1c-a26f-9789618862c2 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:34.888905 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4dc5ac98-7e88-4d1c-a26f-9789618862c2 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1470 microversion: 2.1 time: 0.158788 Aug 01 14:23:34.890207 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 260/524] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:34 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:34.902287 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f8109a97-1c32-4991-ae5c-a1c9b14634a5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:34.902910 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f8109a97-1c32-4991-ae5c-a1c9b14634a5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:34.909693 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f8109a97-1c32-4991-ae5c-a1c9b14634a5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:34.910144 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f8109a97-1c32-4991-ae5c-a1c9b14634a5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:34.910928 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f8109a97-1c32-4991-ae5c-a1c9b14634a5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:34.911355 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f8109a97-1c32-4991-ae5c-a1c9b14634a5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:35.056646 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f8109a97-1c32-4991-ae5c-a1c9b14634a5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:35.065400 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f8109a97-1c32-4991-ae5c-a1c9b14634a5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.167226 Aug 01 14:23:35.066054 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 261/525] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:34 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:35.100779 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3f3c3869-8518-4e50-800c-b87169f03542 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:35.101378 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3f3c3869-8518-4e50-800c-b87169f03542 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:35.107430 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3f3c3869-8518-4e50-800c-b87169f03542 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:35.108396 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3f3c3869-8518-4e50-800c-b87169f03542 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:35.109140 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3f3c3869-8518-4e50-800c-b87169f03542 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:35.109561 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3f3c3869-8518-4e50-800c-b87169f03542 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:35.239815 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3f3c3869-8518-4e50-800c-b87169f03542 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:35.247340 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3f3c3869-8518-4e50-800c-b87169f03542 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1498 microversion: 2.1 time: 0.150375 Aug 01 14:23:35.248162 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 262/526] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:35 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1498 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:35.751543 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-158d2db9-809f-4555-ba4c-a97dc0aefca4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:35.752323 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-158d2db9-809f-4555-ba4c-a97dc0aefca4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:35.761865 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-158d2db9-809f-4555-ba4c-a97dc0aefca4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:35.762318 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-158d2db9-809f-4555-ba4c-a97dc0aefca4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:35.763099 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-158d2db9-809f-4555-ba4c-a97dc0aefca4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:35.763560 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-158d2db9-809f-4555-ba4c-a97dc0aefca4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:35.916623 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-158d2db9-809f-4555-ba4c-a97dc0aefca4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:35.927211 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-158d2db9-809f-4555-ba4c-a97dc0aefca4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:35.928711 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-158d2db9-809f-4555-ba4c-a97dc0aefca4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:35.929977 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-158d2db9-809f-4555-ba4c-a97dc0aefca4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.182435 Aug 01 14:23:35.930542 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 263/527] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:35 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:23:35.935038 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-fc5599fe-b177-4165-a144-364cd3d6f6cf tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:35.935559 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-fc5599fe-b177-4165-a144-364cd3d6f6cf tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:35.942423 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fc5599fe-b177-4165-a144-364cd3d6f6cf tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:35.942871 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fc5599fe-b177-4165-a144-364cd3d6f6cf tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:35.943693 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fc5599fe-b177-4165-a144-364cd3d6f6cf tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:35.944124 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fc5599fe-b177-4165-a144-364cd3d6f6cf tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:35.972555 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-fc5599fe-b177-4165-a144-364cd3d6f6cf tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Going to try to terminate instance {{(pid=118132) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:23:36.054475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-fc5599fe-b177-4165-a144-364cd3d6f6cf tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 204 len: 0 microversion: 2.1 time: 0.122615 Aug 01 14:23:36.055272 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 264/528] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Aug 1 14:23:35 2022] DELETE /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:23:36.059925 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-00bf5fd5-4f31-44af-8501-838c7c4f1b11 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:36.060605 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-00bf5fd5-4f31-44af-8501-838c7c4f1b11 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:36.066700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-00bf5fd5-4f31-44af-8501-838c7c4f1b11 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:36.067142 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-00bf5fd5-4f31-44af-8501-838c7c4f1b11 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:36.067928 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-00bf5fd5-4f31-44af-8501-838c7c4f1b11 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:36.068351 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-00bf5fd5-4f31-44af-8501-838c7c4f1b11 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:36.073651 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:36.205102 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-00bf5fd5-4f31-44af-8501-838c7c4f1b11 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:36.212630 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-00bf5fd5-4f31-44af-8501-838c7c4f1b11 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1470 microversion: 2.1 time: 0.156580 Aug 01 14:23:36.213186 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 265/529] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:36 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:36.218102 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f9ef9e3a-e50f-443b-8f93-e0595f68175f tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:36.218693 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f9ef9e3a-e50f-443b-8f93-e0595f68175f tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:36.224912 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f9ef9e3a-e50f-443b-8f93-e0595f68175f tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:36.225351 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f9ef9e3a-e50f-443b-8f93-e0595f68175f tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:36.226107 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f9ef9e3a-e50f-443b-8f93-e0595f68175f tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:36.226535 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f9ef9e3a-e50f-443b-8f93-e0595f68175f tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:36.357873 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f9ef9e3a-e50f-443b-8f93-e0595f68175f tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:36.366522 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f9ef9e3a-e50f-443b-8f93-e0595f68175f tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1504 microversion: 2.1 time: 0.152357 Aug 01 14:23:36.367092 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 266/530] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:36 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:36.371619 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e3ffee73-eaff-4672-a72e-0acbe2fee952 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:36.372232 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e3ffee73-eaff-4672-a72e-0acbe2fee952 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:36.377996 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e3ffee73-eaff-4672-a72e-0acbe2fee952 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:36.378438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e3ffee73-eaff-4672-a72e-0acbe2fee952 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:36.379199 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e3ffee73-eaff-4672-a72e-0acbe2fee952 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:36.379661 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e3ffee73-eaff-4672-a72e-0acbe2fee952 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:36.512060 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e3ffee73-eaff-4672-a72e-0acbe2fee952 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:36.520959 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e3ffee73-eaff-4672-a72e-0acbe2fee952 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.152853 Aug 01 14:23:36.521534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 267/531] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:36 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:36.954751 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-910e2644-8921-49d0-8ea4-1e6da5862707 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:36.955374 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-910e2644-8921-49d0-8ea4-1e6da5862707 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:36.962300 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-910e2644-8921-49d0-8ea4-1e6da5862707 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:36.962640 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-910e2644-8921-49d0-8ea4-1e6da5862707 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:36.963484 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-910e2644-8921-49d0-8ea4-1e6da5862707 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:36.963971 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-910e2644-8921-49d0-8ea4-1e6da5862707 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:37.098504 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-910e2644-8921-49d0-8ea4-1e6da5862707 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:37.107678 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-910e2644-8921-49d0-8ea4-1e6da5862707 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:37.109870 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-910e2644-8921-49d0-8ea4-1e6da5862707 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:37.111069 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-910e2644-8921-49d0-8ea4-1e6da5862707 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.160412 Aug 01 14:23:37.111657 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 268/532] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:36 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:23:37.233576 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7ebad656-e0b5-4d6a-9a0c-d1fbbdcf5f3a tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:37.234136 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7ebad656-e0b5-4d6a-9a0c-d1fbbdcf5f3a tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:37.240420 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7ebad656-e0b5-4d6a-9a0c-d1fbbdcf5f3a tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:37.240915 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7ebad656-e0b5-4d6a-9a0c-d1fbbdcf5f3a tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:37.241715 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7ebad656-e0b5-4d6a-9a0c-d1fbbdcf5f3a tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:37.242100 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7ebad656-e0b5-4d6a-9a0c-d1fbbdcf5f3a tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:37.381950 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7ebad656-e0b5-4d6a-9a0c-d1fbbdcf5f3a tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:37.390532 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7ebad656-e0b5-4d6a-9a0c-d1fbbdcf5f3a tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1470 microversion: 2.1 time: 0.160359 Aug 01 14:23:37.391098 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 269/533] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:37 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:37.395555 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4e5f419f-e0b4-46ea-a431-6e0c5d7f0949 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:37.396156 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4e5f419f-e0b4-46ea-a431-6e0c5d7f0949 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:37.402365 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4e5f419f-e0b4-46ea-a431-6e0c5d7f0949 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:37.402810 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4e5f419f-e0b4-46ea-a431-6e0c5d7f0949 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:37.403620 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4e5f419f-e0b4-46ea-a431-6e0c5d7f0949 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:37.404055 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4e5f419f-e0b4-46ea-a431-6e0c5d7f0949 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:37.536584 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4e5f419f-e0b4-46ea-a431-6e0c5d7f0949 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:37.544296 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4e5f419f-e0b4-46ea-a431-6e0c5d7f0949 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1504 microversion: 2.1 time: 0.152228 Aug 01 14:23:37.544891 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 270/534] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:37 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:37.549374 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c951ea6a-f958-4c40-b509-460eadf6b340 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:37.549969 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c951ea6a-f958-4c40-b509-460eadf6b340 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:37.555797 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c951ea6a-f958-4c40-b509-460eadf6b340 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:37.556243 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c951ea6a-f958-4c40-b509-460eadf6b340 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:37.556997 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c951ea6a-f958-4c40-b509-460eadf6b340 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:37.557428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c951ea6a-f958-4c40-b509-460eadf6b340 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:37.689925 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c951ea6a-f958-4c40-b509-460eadf6b340 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:37.697477 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c951ea6a-f958-4c40-b509-460eadf6b340 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.151607 Aug 01 14:23:37.698042 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 271/535] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:37 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:38.134288 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f944ac15-4ba0-469d-bbe1-ffbb5917bbcc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:38.134973 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f944ac15-4ba0-469d-bbe1-ffbb5917bbcc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:38.141450 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f944ac15-4ba0-469d-bbe1-ffbb5917bbcc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:38.141892 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f944ac15-4ba0-469d-bbe1-ffbb5917bbcc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:38.142650 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f944ac15-4ba0-469d-bbe1-ffbb5917bbcc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:38.143082 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f944ac15-4ba0-469d-bbe1-ffbb5917bbcc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:38.287140 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f944ac15-4ba0-469d-bbe1-ffbb5917bbcc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:38.295911 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f944ac15-4ba0-469d-bbe1-ffbb5917bbcc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:38.297995 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f944ac15-4ba0-469d-bbe1-ffbb5917bbcc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:38.300301 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f944ac15-4ba0-469d-bbe1-ffbb5917bbcc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.168845 Aug 01 14:23:38.300301 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 272/536] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:38 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:23:38.412764 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4cda8b0b-f920-4d51-a2d5-07fc2254adbc tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:38.413336 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4cda8b0b-f920-4d51-a2d5-07fc2254adbc tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:38.420127 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4cda8b0b-f920-4d51-a2d5-07fc2254adbc tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:38.420646 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4cda8b0b-f920-4d51-a2d5-07fc2254adbc tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:38.421993 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4cda8b0b-f920-4d51-a2d5-07fc2254adbc tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:38.422422 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4cda8b0b-f920-4d51-a2d5-07fc2254adbc tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:38.559985 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4cda8b0b-f920-4d51-a2d5-07fc2254adbc tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:38.566025 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4cda8b0b-f920-4d51-a2d5-07fc2254adbc tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1470 microversion: 2.1 time: 0.157288 Aug 01 14:23:38.566584 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 273/537] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:38 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:38.570950 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-fdabe5be-585c-4c63-8cdd-9af5d083fe55 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:38.571578 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-fdabe5be-585c-4c63-8cdd-9af5d083fe55 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:38.578607 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fdabe5be-585c-4c63-8cdd-9af5d083fe55 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:38.579108 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fdabe5be-585c-4c63-8cdd-9af5d083fe55 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:38.579843 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fdabe5be-585c-4c63-8cdd-9af5d083fe55 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:38.580372 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fdabe5be-585c-4c63-8cdd-9af5d083fe55 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:38.720341 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-fdabe5be-585c-4c63-8cdd-9af5d083fe55 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:38.728075 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-fdabe5be-585c-4c63-8cdd-9af5d083fe55 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1504 microversion: 2.1 time: 0.160561 Aug 01 14:23:38.728895 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 274/538] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:38 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:38.733042 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ef9812c8-ea90-4b97-81bf-6f1d74d48543 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:38.733626 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ef9812c8-ea90-4b97-81bf-6f1d74d48543 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:38.735368 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:38.740685 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ef9812c8-ea90-4b97-81bf-6f1d74d48543 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:38.741118 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ef9812c8-ea90-4b97-81bf-6f1d74d48543 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:38.741871 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ef9812c8-ea90-4b97-81bf-6f1d74d48543 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:38.742293 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ef9812c8-ea90-4b97-81bf-6f1d74d48543 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:38.875100 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ef9812c8-ea90-4b97-81bf-6f1d74d48543 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:38.882542 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ef9812c8-ea90-4b97-81bf-6f1d74d48543 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.152991 Aug 01 14:23:38.883097 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 275/539] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:38 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:39.332824 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0c038fbc-665d-4177-abb2-db44aa7f6eb9 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:39.333483 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0c038fbc-665d-4177-abb2-db44aa7f6eb9 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:39.340042 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0c038fbc-665d-4177-abb2-db44aa7f6eb9 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:39.340486 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0c038fbc-665d-4177-abb2-db44aa7f6eb9 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:39.341255 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0c038fbc-665d-4177-abb2-db44aa7f6eb9 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:39.341679 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0c038fbc-665d-4177-abb2-db44aa7f6eb9 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:39.494860 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0c038fbc-665d-4177-abb2-db44aa7f6eb9 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:39.503702 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0c038fbc-665d-4177-abb2-db44aa7f6eb9 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:39.505223 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0c038fbc-665d-4177-abb2-db44aa7f6eb9 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:39.506417 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0c038fbc-665d-4177-abb2-db44aa7f6eb9 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.177517 Aug 01 14:23:39.506998 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 276/540] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:39 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:23:39.513389 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-45be3147-249a-41f5-a507-b6bdc47a43f1 req-51f70430-bc29-4aa5-9d2f-faeda712b91a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "547bd047-8f47-4a63-957d-f9883e499f1d", "name": "network-vif-unplugged", "status": "completed", "tag": "f0f52d95-439d-46a4-9316-4599ac075066"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:39.527249 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-45be3147-249a-41f5-a507-b6bdc47a43f1 req-51f70430-bc29-4aa5-9d2f-faeda712b91a service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:39.527780 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-45be3147-249a-41f5-a507-b6bdc47a43f1 req-51f70430-bc29-4aa5-9d2f-faeda712b91a service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:39.543788 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-45be3147-249a-41f5-a507-b6bdc47a43f1 req-51f70430-bc29-4aa5-9d2f-faeda712b91a service nova] Creating event network-vif-unplugged:f0f52d95-439d-46a4-9316-4599ac075066 for instance 547bd047-8f47-4a63-957d-f9883e499f1d on hv-cinder-84599 Aug 01 14:23:39.550666 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-45be3147-249a-41f5-a507-b6bdc47a43f1 req-51f70430-bc29-4aa5-9d2f-faeda712b91a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042379 Aug 01 14:23:39.551532 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 277/541] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:23:39.591611 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7f674e49-d537-4cef-9610-1419375329db tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:39.592414 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7f674e49-d537-4cef-9610-1419375329db tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:39.601414 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7f674e49-d537-4cef-9610-1419375329db tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:39.601758 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7f674e49-d537-4cef-9610-1419375329db tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:39.602542 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7f674e49-d537-4cef-9610-1419375329db tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:39.602970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7f674e49-d537-4cef-9610-1419375329db tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:39.875171 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7da40e9c-1e8a-4c61-b876-bf370fc5dad3 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "POST /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.605003 Aug 01 14:23:39.879951 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 265/542] 10.222.0.17 () {60 vars in 1323 bytes} [Mon Aug 1 14:23:34 2022] POST /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a/os-volume_attachments => generated 194 bytes in 5611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:23:39.886829 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c970fb71-a532-40e5-b5da-ba648777e12d tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:39.887654 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c970fb71-a532-40e5-b5da-ba648777e12d tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:39.896366 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c970fb71-a532-40e5-b5da-ba648777e12d tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:39.896892 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c970fb71-a532-40e5-b5da-ba648777e12d tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:39.897927 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c970fb71-a532-40e5-b5da-ba648777e12d tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:39.898652 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c970fb71-a532-40e5-b5da-ba648777e12d tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:40.068308 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c970fb71-a532-40e5-b5da-ba648777e12d tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:40.079522 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c970fb71-a532-40e5-b5da-ba648777e12d tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1504 microversion: 2.1 time: 0.197980 Aug 01 14:23:40.080509 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 266/543] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:39 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1504 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:40.087301 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-093e57a0-5cc5-472c-bb42-3d5aa0132cb6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:40.088489 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-093e57a0-5cc5-472c-bb42-3d5aa0132cb6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:40.095779 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-093e57a0-5cc5-472c-bb42-3d5aa0132cb6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:40.096353 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-093e57a0-5cc5-472c-bb42-3d5aa0132cb6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:40.097207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-093e57a0-5cc5-472c-bb42-3d5aa0132cb6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:40.097732 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-093e57a0-5cc5-472c-bb42-3d5aa0132cb6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:40.165587 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7f674e49-d537-4cef-9610-1419375329db tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:40.175056 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7f674e49-d537-4cef-9610-1419375329db tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1470 microversion: 2.1 time: 0.589203 Aug 01 14:23:40.187485 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 278/544] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:39 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1470 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:40.255850 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-093e57a0-5cc5-472c-bb42-3d5aa0132cb6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:40.264442 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-093e57a0-5cc5-472c-bb42-3d5aa0132cb6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.182323 Aug 01 14:23:40.265117 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 267/545] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:40 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:40.541385 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a960b685-1ed4-425c-87e7-1f12f0b4cf41 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:40.542011 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a960b685-1ed4-425c-87e7-1f12f0b4cf41 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:40.549657 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a960b685-1ed4-425c-87e7-1f12f0b4cf41 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:40.550179 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a960b685-1ed4-425c-87e7-1f12f0b4cf41 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:40.550944 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a960b685-1ed4-425c-87e7-1f12f0b4cf41 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:40.551374 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a960b685-1ed4-425c-87e7-1f12f0b4cf41 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:40.553996 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-0d39c13a-90da-420b-af8d-873a576bebe3 req-814a5297-0331-44ce-9ab3-fcbec34661bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "547bd047-8f47-4a63-957d-f9883e499f1d", "name": "network-vif-deleted", "tag": "f0f52d95-439d-46a4-9316-4599ac075066"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:40.564780 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-0d39c13a-90da-420b-af8d-873a576bebe3 req-814a5297-0331-44ce-9ab3-fcbec34661bc service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:40.565341 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-0d39c13a-90da-420b-af8d-873a576bebe3 req-814a5297-0331-44ce-9ab3-fcbec34661bc service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:40.580305 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-0d39c13a-90da-420b-af8d-873a576bebe3 req-814a5297-0331-44ce-9ab3-fcbec34661bc service nova] Creating event network-vif-deleted:f0f52d95-439d-46a4-9316-4599ac075066 for instance 547bd047-8f47-4a63-957d-f9883e499f1d on hv-cinder-84599 Aug 01 14:23:40.600483 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-0d39c13a-90da-420b-af8d-873a576bebe3 req-814a5297-0331-44ce-9ab3-fcbec34661bc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049814 Aug 01 14:23:40.603181 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 268/546] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:23:40.707723 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a960b685-1ed4-425c-87e7-1f12f0b4cf41 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:40.719317 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a960b685-1ed4-425c-87e7-1f12f0b4cf41 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:40.721183 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a960b685-1ed4-425c-87e7-1f12f0b4cf41 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:40.722367 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a960b685-1ed4-425c-87e7-1f12f0b4cf41 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.184814 Aug 01 14:23:40.722927 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 279/547] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:40 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:41.105934 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8990ed81-2e99-4465-8c15-af604cad2f11 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:41.106681 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8990ed81-2e99-4465-8c15-af604cad2f11 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:41.113656 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8990ed81-2e99-4465-8c15-af604cad2f11 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:41.114261 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8990ed81-2e99-4465-8c15-af604cad2f11 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:41.115289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8990ed81-2e99-4465-8c15-af604cad2f11 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:41.115961 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8990ed81-2e99-4465-8c15-af604cad2f11 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:41.202954 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6086b233-66b3-4ea7-8f85-164b9580f0fd tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:41.204064 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-6086b233-66b3-4ea7-8f85-164b9580f0fd tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:41.211056 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6086b233-66b3-4ea7-8f85-164b9580f0fd tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:41.213671 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6086b233-66b3-4ea7-8f85-164b9580f0fd tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:41.214580 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6086b233-66b3-4ea7-8f85-164b9580f0fd tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:41.215097 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6086b233-66b3-4ea7-8f85-164b9580f0fd tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:41.254116 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6086b233-66b3-4ea7-8f85-164b9580f0fd tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:41.254603 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6086b233-66b3-4ea7-8f85-164b9580f0fd tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:41.255038 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-6086b233-66b3-4ea7-8f85-164b9580f0fd tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lazy-loading 'fault' on Instance uuid 547bd047-8f47-4a63-957d-f9883e499f1d {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:23:41.305186 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8990ed81-2e99-4465-8c15-af604cad2f11 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:41.314468 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8990ed81-2e99-4465-8c15-af604cad2f11 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1504 microversion: 2.1 time: 0.214456 Aug 01 14:23:41.315062 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 269/548] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:41 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1504 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:41.319796 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7a832d19-6012-469e-8802-441f7946a3f7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:41.320408 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7a832d19-6012-469e-8802-441f7946a3f7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:41.326718 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7a832d19-6012-469e-8802-441f7946a3f7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:41.327406 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7a832d19-6012-469e-8802-441f7946a3f7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:41.328210 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7a832d19-6012-469e-8802-441f7946a3f7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:41.328642 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7a832d19-6012-469e-8802-441f7946a3f7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:41.351800 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6086b233-66b3-4ea7-8f85-164b9580f0fd tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5711f44f73e4925ae52a784f43a2a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f6ab4a05704f8c97a5e1883becb247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:41.361827 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6086b233-66b3-4ea7-8f85-164b9580f0fd tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 200 len: 1304 microversion: 2.1 time: 0.163058 Aug 01 14:23:41.363071 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 280/549] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:41 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 1304 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:41.498558 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7a832d19-6012-469e-8802-441f7946a3f7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:41.506849 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7a832d19-6012-469e-8802-441f7946a3f7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1502 microversion: 2.1 time: 0.190682 Aug 01 14:23:41.521775 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 270/550] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:41 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1502 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:41.528527 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2bb98e6e-7f63-4dd2-b27f-12536f4446e6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bed1de14-28be-4a34-9c87-2ce8187a5b1d"}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:41.531609 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2bb98e6e-7f63-4dd2-b27f-12536f4446e6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:41.537977 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2bb98e6e-7f63-4dd2-b27f-12536f4446e6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:41.538498 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2bb98e6e-7f63-4dd2-b27f-12536f4446e6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:41.539500 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2bb98e6e-7f63-4dd2-b27f-12536f4446e6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:41.539960 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2bb98e6e-7f63-4dd2-b27f-12536f4446e6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:41.566914 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-2bb98e6e-7f63-4dd2-b27f-12536f4446e6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] HTTP exception thrown: Cannot 'attach_volume' instance 2775d75f-b4fd-451b-bba5-471868aafc29 while it is in vm_state rescued Aug 01 14:23:41.568970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2bb98e6e-7f63-4dd2-b27f-12536f4446e6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Request method failure captured: Aug 01 14:23:41.568970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: request: POST /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29/os-volume_attachments HTTP/1.1 Aug 01 14:23:41.568970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept: application/json Aug 01 14:23:41.568970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Aug 01 14:23:41.568970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Connection: close Aug 01 14:23:41.568970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Length: 74 Aug 01 14:23:41.568970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Type: application/json Aug 01 14:23:41.568970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Host: 10.222.0.17 Aug 01 14:23:41.568970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Aug 01 14:23:41.568970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.10 Aug 01 14:23:41.568970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABi5-F11vtUeswQDfyKUVNd6Q87sVfV5PCR7Xd2YFUfSTJWvW9H9BSU4X5lFb9W0uL4F8nItvzcQSbBv2rf9PJYyTBlLiQDJSVh8lDqem48k4DbhTBdctnFQI9X7sX_oT1CnuXpX_5VYrPdv-R-oZXqnj9WBTnSUyuTG5740iwyNCsCcJ0 Aug 01 14:23:41.568970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Aug 01 14:23:41.568970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Aug 01 14:23:41.568970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Aug 01 14:23:41.568970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Aug 01 14:23:41.568970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Aug 01 14:23:41.568970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Aug 01 14:23:41.568970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Id: 7b6f2af7de6b4e888e702c78f655448a Aug 01 14:23:41.568970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1825573094 Aug 01 14:23:41.568970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Role: reader,member Aug 01 14:23:41.568970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Roles: reader,member Aug 01 14:23:41.570797 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7b6f2af7de6b4e888e702c78f655448a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7b6f2af7de6b4e888e702c78f655448a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7b6f2af7de6b4e888e702c78f655448a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7b6f2af7de6b4e888e702c78f655448a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:23:41.570797 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1825573094 Aug 01 14:23:41.570797 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 7b6f2af7de6b4e888e702c78f655448a Aug 01 14:23:41.570797 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1825573094 Aug 01 14:23:41.570797 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User: tempest-ServerRescueNegativeTestJSON-1825573094-project Aug 01 14:23:41.570797 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Aug 01 14:23:41.570797 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Aug 01 14:23:41.570797 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Id: c487e443eb274090bce842e855b015ec Aug 01 14:23:41.570797 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1825573094-project Aug 01 14:23:41.570797 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Aug 01 14:23:41.570797 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {"volumeAttachment": {"volumeId": "bed1de14-28be-4a34-9c87-2ce8187a5b1d"}} Aug 01 14:23:41.570797 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: method: > Aug 01 14:23:41.571848 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: exception: Cannot 'attach_volume' instance 2775d75f-b4fd-451b-bba5-471868aafc29 while it is in vm_state rescued Aug 01 14:23:41.571848 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: action_args: {'server_id': '2775d75f-b4fd-451b-bba5-471868aafc29', 'body': {'volumeAttachment': {'volumeId': 'bed1de14-28be-4a34-9c87-2ce8187a5b1d'}}} Aug 01 14:23:41.571848 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:23:41.571848 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:23:41.571848 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 14:23:41.571848 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 14:23:41.571848 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 14:23:41.571848 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 14:23:41.571848 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 01 14:23:41.571848 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 01 14:23:41.571848 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2775d75f-b4fd-451b-bba5-471868aafc29 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 01 14:23:41.571848 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:23:41.571848 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:23:41.571848 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:23:41.571848 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:23:41.571848 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:23:41.571848 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:23:41.571848 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:23:41.571848 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:23:41.573232 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:23:41.573232 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:23:41.573232 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:23:41.573232 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:23:41.573232 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:23:41.573232 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:23:41.573232 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:23:41.573232 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:23:41.573232 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 01 14:23:41.573232 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 01 14:23:41.573232 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 01 14:23:41.573232 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 01 14:23:41.573232 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2775d75f-b4fd-451b-bba5-471868aafc29 while it is in vm_state rescued Aug 01 14:23:41.573232 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:23:41.573232 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:23:41.573232 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:23:41.573232 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:23:41.573232 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:23:41.573232 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:23:41.576386 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:23:41.576386 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:23:41.576386 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2775d75f-b4fd-451b-bba5-471868aafc29 while it is in vm_state rescued Aug 01 14:23:41.576386 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:23:41.576386 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2bb98e6e-7f63-4dd2-b27f-12536f4446e6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Returning 409 to user: Cannot 'attach_volume' instance 2775d75f-b4fd-451b-bba5-471868aafc29 while it is in vm_state rescued {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:23:41.576386 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2bb98e6e-7f63-4dd2-b27f-12536f4446e6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "POST /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046278 Aug 01 14:23:41.576386 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 281/551] 10.222.0.17 () {60 vars in 1323 bytes} [Mon Aug 1 14:23:41 2022] POST /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 01 14:23:41.580530 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8fbcae5f-566a-4dec-8896-a311f578523b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:41.581113 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8fbcae5f-566a-4dec-8896-a311f578523b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:41.587087 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8fbcae5f-566a-4dec-8896-a311f578523b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:41.587574 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8fbcae5f-566a-4dec-8896-a311f578523b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:41.588351 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8fbcae5f-566a-4dec-8896-a311f578523b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:41.588790 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8fbcae5f-566a-4dec-8896-a311f578523b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:41.633416 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:41.661576 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8fbcae5f-566a-4dec-8896-a311f578523b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "POST /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29/action" status: 202 len: 0 microversion: 2.1 time: 0.084916 Aug 01 14:23:41.665568 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 271/552] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Aug 1 14:23:41 2022] POST /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:23:41.670520 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d2df26d5-158f-4c32-8144-8eaf01d5a7d4 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:41.671160 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d2df26d5-158f-4c32-8144-8eaf01d5a7d4 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:41.678917 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d2df26d5-158f-4c32-8144-8eaf01d5a7d4 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:41.679505 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d2df26d5-158f-4c32-8144-8eaf01d5a7d4 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:41.681092 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d2df26d5-158f-4c32-8144-8eaf01d5a7d4 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:41.681092 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d2df26d5-158f-4c32-8144-8eaf01d5a7d4 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:41.700997 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=100 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:41.746897 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6b55ce8b-d2aa-45ea-b075-59a51ebefb18 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:41.747668 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-6b55ce8b-d2aa-45ea-b075-59a51ebefb18 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:41.754924 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6b55ce8b-d2aa-45ea-b075-59a51ebefb18 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:41.755376 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6b55ce8b-d2aa-45ea-b075-59a51ebefb18 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:41.756226 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6b55ce8b-d2aa-45ea-b075-59a51ebefb18 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:41.756651 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6b55ce8b-d2aa-45ea-b075-59a51ebefb18 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:41.822775 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d2df26d5-158f-4c32-8144-8eaf01d5a7d4 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:41.831186 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d2df26d5-158f-4c32-8144-8eaf01d5a7d4 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1510 microversion: 2.1 time: 0.164505 Aug 01 14:23:41.832063 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 282/553] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:41 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:41.885417 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:23:41.885643 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Mon Aug 1 14:23:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:23:41.901264 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6b55ce8b-d2aa-45ea-b075-59a51ebefb18 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:41.911939 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6b55ce8b-d2aa-45ea-b075-59a51ebefb18 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:41.913563 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6b55ce8b-d2aa-45ea-b075-59a51ebefb18 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:41.914791 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6b55ce8b-d2aa-45ea-b075-59a51ebefb18 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.172400 Aug 01 14:23:41.915412 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 272/554] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:41 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:23:42.338988 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1b710a51-38a0-4963-a3a4-f838776436c8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:42.340345 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-1b710a51-38a0-4963-a3a4-f838776436c8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:42.349510 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1b710a51-38a0-4963-a3a4-f838776436c8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:42.350553 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1b710a51-38a0-4963-a3a4-f838776436c8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:42.352024 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1b710a51-38a0-4963-a3a4-f838776436c8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:42.352936 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1b710a51-38a0-4963-a3a4-f838776436c8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:42.383727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-434a992a-6a6a-40da-9a87-ff0a7fd00018 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:42.386133 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-434a992a-6a6a-40da-9a87-ff0a7fd00018 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] [instance: 547bd047-8f47-4a63-957d-f9883e499f1d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:42.404020 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-434a992a-6a6a-40da-9a87-ff0a7fd00018 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:42.404920 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-434a992a-6a6a-40da-9a87-ff0a7fd00018 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:42.406020 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-434a992a-6a6a-40da-9a87-ff0a7fd00018 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:42.406867 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-434a992a-6a6a-40da-9a87-ff0a7fd00018 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:42.407516 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1b710a51-38a0-4963-a3a4-f838776436c8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:42.408062 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1b710a51-38a0-4963-a3a4-f838776436c8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:42.408571 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-1b710a51-38a0-4963-a3a4-f838776436c8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lazy-loading 'fault' on Instance uuid f154e329-6643-4151-8508-5bf8d82bad04 {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:23:42.423851 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-434a992a-6a6a-40da-9a87-ff0a7fd00018 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] HTTP exception thrown: Instance 547bd047-8f47-4a63-957d-f9883e499f1d could not be found. Aug 01 14:23:42.425831 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-434a992a-6a6a-40da-9a87-ff0a7fd00018 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Request method failure captured: Aug 01 14:23:42.425831 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d HTTP/1.1 Aug 01 14:23:42.425831 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:23:42.425831 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:23:42.425831 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:23:42.425831 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 0 Aug 01 14:23:42.425831 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:23:42.425831 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:23:42.425831 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:23:42.425831 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:23:42.425831 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-G88eUiuqJ_NJ4ClRkpOETzQgfys-DrGkesi-ga3kNJAuo8KcwEkpqjlGUw99xd8BnSq_3WYjuL5zPXyZDUb1Abj4IzAfx8XjzUxBQhNzUI_uqjJ4oMNKg2LbgHov5jzH41GEb8LmCYS_j2mmzKkOt-ThrMSeqVDeV8KEMY6ir6K7Y Aug 01 14:23:42.425831 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:23:42.425831 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:23:42.425831 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:23:42.425831 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:23:42.425831 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:23:42.425831 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:23:42.425831 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: 27f6ab4a05704f8c97a5e1883becb247 Aug 01 14:23:42.425831 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-VolumesNegativeTest-1085834988 Aug 01 14:23:42.425831 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:23:42.425831 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:23:42.427187 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/27f6ab4a05704f8c97a5e1883becb247"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/27f6ab4a05704f8c97a5e1883becb247"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/27f6ab4a05704f8c97a5e1883becb247"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_27f6ab4a05704f8c97a5e1883becb247", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:23:42.427187 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-VolumesNegativeTest-1085834988 Aug 01 14:23:42.427187 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 27f6ab4a05704f8c97a5e1883becb247 Aug 01 14:23:42.427187 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-VolumesNegativeTest-1085834988 Aug 01 14:23:42.427187 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-VolumesNegativeTest-1085834988-project Aug 01 14:23:42.427187 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:23:42.427187 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:23:42.427187 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: a5711f44f73e4925ae52a784f43a2a1c Aug 01 14:23:42.427187 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-VolumesNegativeTest-1085834988-project Aug 01 14:23:42.427187 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: > Aug 01 14:23:42.427187 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Instance 547bd047-8f47-4a63-957d-f9883e499f1d could not be found. Aug 01 14:23:42.427187 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'id': '547bd047-8f47-4a63-957d-f9883e499f1d'} Aug 01 14:23:42.428059 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:23:42.428059 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:23:42.428059 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:23:42.428059 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:23:42.428059 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:23:42.428059 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:23:42.428059 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:23:42.428059 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:23:42.428059 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:23:42.428059 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:23:42.428059 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 547bd047-8f47-4a63-957d-f9883e499f1d could not be found. Aug 01 14:23:42.428059 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:23:42.428059 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:23:42.428059 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:23:42.428059 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:23:42.428059 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:23:42.428059 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:23:42.428059 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:23:42.428059 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:23:42.428059 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:23:42.429219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:23:42.429219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:23:42.429219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:23:42.429219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:23:42.429219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:23:42.429219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:23:42.429219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:23:42.429219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 547bd047-8f47-4a63-957d-f9883e499f1d could not be found. Aug 01 14:23:42.429219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:23:42.429219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:23:42.429219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:23:42.429219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:23:42.429219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:23:42.429219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:23:42.429219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:23:42.429219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:23:42.429219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 547bd047-8f47-4a63-957d-f9883e499f1d could not be found. Aug 01 14:23:42.429219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:23:42.430372 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-434a992a-6a6a-40da-9a87-ff0a7fd00018 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] Returning 404 to user: Instance 547bd047-8f47-4a63-957d-f9883e499f1d could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:23:42.430372 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-434a992a-6a6a-40da-9a87-ff0a7fd00018 tempest-VolumesNegativeTest-1085834988 tempest-VolumesNegativeTest-1085834988-project] 10.222.0.17 "GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d" status: 404 len: 111 microversion: 2.1 time: 0.048856 Aug 01 14:23:42.432222 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 273/555] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:42 2022] GET /compute/v2.1/servers/547bd047-8f47-4a63-957d-f9883e499f1d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:23:42.497793 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1b710a51-38a0-4963-a3a4-f838776436c8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbdf80e14b647cbbdb3d292d534d987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dd5eef6c62467ab15a23233e366185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:42.507041 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-1b710a51-38a0-4963-a3a4-f838776436c8 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 200 len: 1304 microversion: 2.1 time: 0.174260 Aug 01 14:23:42.511526 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 283/556] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:42 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 1304 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:42.665047 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-d495ef5d-2126-4890-b0e3-4d93455207dd req-edf97764-5ee9-44a6-8f59-41beb2ff23f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f154e329-6643-4151-8508-5bf8d82bad04", "name": "network-vif-deleted", "tag": "a0e1b0ef-e868-410c-9b5b-fad69afb99c2"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:42.678362 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-d495ef5d-2126-4890-b0e3-4d93455207dd req-edf97764-5ee9-44a6-8f59-41beb2ff23f2 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:42.678963 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-d495ef5d-2126-4890-b0e3-4d93455207dd req-edf97764-5ee9-44a6-8f59-41beb2ff23f2 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:42.696758 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-d495ef5d-2126-4890-b0e3-4d93455207dd req-edf97764-5ee9-44a6-8f59-41beb2ff23f2 service nova] Creating event network-vif-deleted:a0e1b0ef-e868-410c-9b5b-fad69afb99c2 for instance f154e329-6643-4151-8508-5bf8d82bad04 on hv-cinder-84599 Aug 01 14:23:42.708050 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-d495ef5d-2126-4890-b0e3-4d93455207dd req-edf97764-5ee9-44a6-8f59-41beb2ff23f2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047061 Aug 01 14:23:42.718410 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 274/557] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:23:42.855330 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ce7c0317-b15d-4eb4-9798-a14be41247b0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:42.855983 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ce7c0317-b15d-4eb4-9798-a14be41247b0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:42.863183 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ce7c0317-b15d-4eb4-9798-a14be41247b0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:42.863666 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ce7c0317-b15d-4eb4-9798-a14be41247b0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:42.864440 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ce7c0317-b15d-4eb4-9798-a14be41247b0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:42.864873 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ce7c0317-b15d-4eb4-9798-a14be41247b0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:42.939254 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-698c3d20-93be-4dc9-aba6-3efaae5e990a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:42.940360 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-698c3d20-93be-4dc9-aba6-3efaae5e990a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:42.949434 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-698c3d20-93be-4dc9-aba6-3efaae5e990a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:42.950098 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-698c3d20-93be-4dc9-aba6-3efaae5e990a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:42.951382 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-698c3d20-93be-4dc9-aba6-3efaae5e990a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:42.953021 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-698c3d20-93be-4dc9-aba6-3efaae5e990a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:43.023055 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ce7c0317-b15d-4eb4-9798-a14be41247b0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:43.033313 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ce7c0317-b15d-4eb4-9798-a14be41247b0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1510 microversion: 2.1 time: 0.183476 Aug 01 14:23:43.033907 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 284/558] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:42 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1510 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:43.111808 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-698c3d20-93be-4dc9-aba6-3efaae5e990a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:43.121105 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-698c3d20-93be-4dc9-aba6-3efaae5e990a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:43.123012 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-698c3d20-93be-4dc9-aba6-3efaae5e990a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:43.124439 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-698c3d20-93be-4dc9-aba6-3efaae5e990a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.189341 Aug 01 14:23:43.125251 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 275/559] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:42 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:43.534092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-8c862f72-bcae-4625-9bca-a54b86b4870a req-6c27147a-9d0f-4bc5-b28c-7986c5f66c23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76deb7da-88aa-4c26-b55d-fd6432d1e680", "name": "network-vif-plugged", "status": "completed", "tag": "e905a309-fe29-4762-880d-f6eb375da04f"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:43.537041 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-300c46c7-aaac-4db1-8440-381779a7cd12 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:43.537844 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-300c46c7-aaac-4db1-8440-381779a7cd12 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] [instance: f154e329-6643-4151-8508-5bf8d82bad04] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:43.554141 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-300c46c7-aaac-4db1-8440-381779a7cd12 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:43.554525 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-300c46c7-aaac-4db1-8440-381779a7cd12 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:43.555864 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-300c46c7-aaac-4db1-8440-381779a7cd12 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:43.556333 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-300c46c7-aaac-4db1-8440-381779a7cd12 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:43.560413 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-8c862f72-bcae-4625-9bca-a54b86b4870a req-6c27147a-9d0f-4bc5-b28c-7986c5f66c23 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:43.560863 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-8c862f72-bcae-4625-9bca-a54b86b4870a req-6c27147a-9d0f-4bc5-b28c-7986c5f66c23 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:43.582502 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-300c46c7-aaac-4db1-8440-381779a7cd12 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] HTTP exception thrown: Instance f154e329-6643-4151-8508-5bf8d82bad04 could not be found. Aug 01 14:23:43.584311 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-300c46c7-aaac-4db1-8440-381779a7cd12 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Request method failure captured: Aug 01 14:23:43.584311 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 HTTP/1.1 Aug 01 14:23:43.584311 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept: application/json Aug 01 14:23:43.584311 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Aug 01 14:23:43.584311 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Connection: close Aug 01 14:23:43.584311 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Length: 0 Aug 01 14:23:43.584311 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Type: application/json Aug 01 14:23:43.584311 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Host: 10.222.0.17 Aug 01 14:23:43.584311 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Aug 01 14:23:43.584311 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.10 Aug 01 14:23:43.584311 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABi5-GFxbdjrwFdZren7AO9_AKYeM_pxcE9VH6kIVZb6K0ImNpX9YZM_oQ9gZS_edK4ZWneGdBEpWTTub7cJMyNUuXO9VT0E6LhGkdXNPDiD3iG-t7NUaYuJ_cemnHQpCvf82epVm9c6lv_O2_0BkJ17ja7vBCSOzO9nu7vSFmluYcC0Eo Aug 01 14:23:43.584311 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Aug 01 14:23:43.584311 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Aug 01 14:23:43.584311 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Aug 01 14:23:43.584311 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Aug 01 14:23:43.584311 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Aug 01 14:23:43.584311 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Aug 01 14:23:43.584311 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Id: d6dd5eef6c62467ab15a23233e366185 Aug 01 14:23:43.584311 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-VolumesActionsTest-962457200 Aug 01 14:23:43.584311 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Role: reader,member Aug 01 14:23:43.584311 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Roles: reader,member Aug 01 14:23:43.585774 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d6dd5eef6c62467ab15a23233e366185"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d6dd5eef6c62467ab15a23233e366185"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d6dd5eef6c62467ab15a23233e366185"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d6dd5eef6c62467ab15a23233e366185", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:23:43.585774 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-VolumesActionsTest-962457200 Aug 01 14:23:43.585774 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Id: d6dd5eef6c62467ab15a23233e366185 Aug 01 14:23:43.585774 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-VolumesActionsTest-962457200 Aug 01 14:23:43.585774 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User: tempest-VolumesActionsTest-962457200-project Aug 01 14:23:43.585774 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Aug 01 14:23:43.585774 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Aug 01 14:23:43.585774 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Id: bbbdf80e14b647cbbdb3d292d534d987 Aug 01 14:23:43.585774 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-VolumesActionsTest-962457200-project Aug 01 14:23:43.585774 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: method: > Aug 01 14:23:43.585774 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: exception: Instance f154e329-6643-4151-8508-5bf8d82bad04 could not be found. Aug 01 14:23:43.585774 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: action_args: {'id': 'f154e329-6643-4151-8508-5bf8d82bad04'} Aug 01 14:23:43.586613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:23:43.586613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:23:43.586613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:23:43.586613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:23:43.586613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:23:43.586613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:23:43.586613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:23:43.586613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:23:43.586613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:23:43.586613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:23:43.586613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f154e329-6643-4151-8508-5bf8d82bad04 could not be found. Aug 01 14:23:43.586613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:23:43.586613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:23:43.586613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:23:43.586613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:23:43.586613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:23:43.586613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:23:43.586613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:23:43.586613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:23:43.586613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:23:43.588778 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:23:43.588778 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:23:43.588778 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:23:43.588778 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:23:43.588778 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:23:43.588778 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:23:43.588778 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:23:43.588778 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f154e329-6643-4151-8508-5bf8d82bad04 could not be found. Aug 01 14:23:43.588778 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:23:43.588778 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:23:43.588778 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:23:43.588778 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:23:43.588778 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:23:43.588778 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:23:43.588778 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:23:43.588778 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:23:43.588778 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f154e329-6643-4151-8508-5bf8d82bad04 could not be found. Aug 01 14:23:43.588778 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:23:43.591797 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-8c862f72-bcae-4625-9bca-a54b86b4870a req-6c27147a-9d0f-4bc5-b28c-7986c5f66c23 service nova] Creating event network-vif-plugged:e905a309-fe29-4762-880d-f6eb375da04f for instance 76deb7da-88aa-4c26-b55d-fd6432d1e680 on hv-cinder-84599 Aug 01 14:23:43.591927 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-300c46c7-aaac-4db1-8440-381779a7cd12 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] Returning 404 to user: Instance f154e329-6643-4151-8508-5bf8d82bad04 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:23:43.591927 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-300c46c7-aaac-4db1-8440-381779a7cd12 tempest-VolumesActionsTest-962457200 tempest-VolumesActionsTest-962457200-project] 10.222.0.17 "GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04" status: 404 len: 111 microversion: 2.1 time: 0.060799 Aug 01 14:23:43.591927 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 285/560] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:43 2022] GET /compute/v2.1/servers/f154e329-6643-4151-8508-5bf8d82bad04 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:23:43.602353 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-8c862f72-bcae-4625-9bca-a54b86b4870a req-6c27147a-9d0f-4bc5-b28c-7986c5f66c23 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072998 Aug 01 14:23:43.603197 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 276/561] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:23:44.060401 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a3d9f8c1-a904-412f-994c-8ed8f8f2e2bd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:44.061816 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a3d9f8c1-a904-412f-994c-8ed8f8f2e2bd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:44.072981 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a3d9f8c1-a904-412f-994c-8ed8f8f2e2bd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:44.072981 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a3d9f8c1-a904-412f-994c-8ed8f8f2e2bd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:44.074204 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a3d9f8c1-a904-412f-994c-8ed8f8f2e2bd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:44.075940 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a3d9f8c1-a904-412f-994c-8ed8f8f2e2bd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:44.153769 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9ec6a513-af33-4cf4-b9ed-a8ea23e64868 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:44.155371 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9ec6a513-af33-4cf4-b9ed-a8ea23e64868 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:44.164429 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9ec6a513-af33-4cf4-b9ed-a8ea23e64868 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:44.165365 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9ec6a513-af33-4cf4-b9ed-a8ea23e64868 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:44.166343 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9ec6a513-af33-4cf4-b9ed-a8ea23e64868 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:44.167093 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9ec6a513-af33-4cf4-b9ed-a8ea23e64868 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:44.240907 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a3d9f8c1-a904-412f-994c-8ed8f8f2e2bd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:44.248728 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a3d9f8c1-a904-412f-994c-8ed8f8f2e2bd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1510 microversion: 2.1 time: 0.193681 Aug 01 14:23:44.251090 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 286/562] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:44 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1510 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:44.363051 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9ec6a513-af33-4cf4-b9ed-a8ea23e64868 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:44.373857 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9ec6a513-af33-4cf4-b9ed-a8ea23e64868 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:44.376036 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9ec6a513-af33-4cf4-b9ed-a8ea23e64868 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:44.377453 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9ec6a513-af33-4cf4-b9ed-a8ea23e64868 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.230235 Aug 01 14:23:44.378680 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 277/563] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:44 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:23:45.273255 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-97d2a8e5-748d-4719-8cb2-767714ed2443 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:45.273931 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-97d2a8e5-748d-4719-8cb2-767714ed2443 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:45.281298 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-97d2a8e5-748d-4719-8cb2-767714ed2443 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:45.281747 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-97d2a8e5-748d-4719-8cb2-767714ed2443 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:45.282601 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-97d2a8e5-748d-4719-8cb2-767714ed2443 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:45.283040 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-97d2a8e5-748d-4719-8cb2-767714ed2443 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:45.402915 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-65f7e84a-bf70-4840-be04-a789bd2a35dc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:45.404195 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-65f7e84a-bf70-4840-be04-a789bd2a35dc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:45.411122 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-65f7e84a-bf70-4840-be04-a789bd2a35dc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:45.411670 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-65f7e84a-bf70-4840-be04-a789bd2a35dc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:45.412347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-65f7e84a-bf70-4840-be04-a789bd2a35dc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:45.412932 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-65f7e84a-bf70-4840-be04-a789bd2a35dc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:45.443253 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-97d2a8e5-748d-4719-8cb2-767714ed2443 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:45.451207 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-97d2a8e5-748d-4719-8cb2-767714ed2443 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1510 microversion: 2.1 time: 0.181879 Aug 01 14:23:45.452224 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 287/564] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:45 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1510 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:45.559823 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-65f7e84a-bf70-4840-be04-a789bd2a35dc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:45.574792 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-65f7e84a-bf70-4840-be04-a789bd2a35dc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:45.576395 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-65f7e84a-bf70-4840-be04-a789bd2a35dc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:45.578187 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-65f7e84a-bf70-4840-be04-a789bd2a35dc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.179291 Aug 01 14:23:45.578795 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 278/565] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:45 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:23:46.473771 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-eddb648a-7a6e-49c6-89c9-f1bcc3008991 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:46.474541 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-eddb648a-7a6e-49c6-89c9-f1bcc3008991 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:46.481317 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eddb648a-7a6e-49c6-89c9-f1bcc3008991 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:46.481933 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eddb648a-7a6e-49c6-89c9-f1bcc3008991 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:46.482708 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eddb648a-7a6e-49c6-89c9-f1bcc3008991 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:46.483147 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eddb648a-7a6e-49c6-89c9-f1bcc3008991 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:46.603320 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-447b1c0b-6452-4ef7-8349-6256b93dd05d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:46.603973 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-447b1c0b-6452-4ef7-8349-6256b93dd05d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:46.613739 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-447b1c0b-6452-4ef7-8349-6256b93dd05d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:46.614540 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-447b1c0b-6452-4ef7-8349-6256b93dd05d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:46.616196 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-447b1c0b-6452-4ef7-8349-6256b93dd05d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:46.616982 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-447b1c0b-6452-4ef7-8349-6256b93dd05d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:46.643062 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-eddb648a-7a6e-49c6-89c9-f1bcc3008991 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:46.654214 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-eddb648a-7a6e-49c6-89c9-f1bcc3008991 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1510 microversion: 2.1 time: 0.184901 Aug 01 14:23:46.654901 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 288/566] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:46 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1510 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:46.802819 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-447b1c0b-6452-4ef7-8349-6256b93dd05d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:46.812104 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-447b1c0b-6452-4ef7-8349-6256b93dd05d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:46.813614 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-447b1c0b-6452-4ef7-8349-6256b93dd05d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:46.814776 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-447b1c0b-6452-4ef7-8349-6256b93dd05d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.215799 Aug 01 14:23:46.815333 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 279/567] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:46 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:23:47.570681 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a423d8d9-187e-48a0-a084-0cde70e6e36d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:47.571259 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a423d8d9-187e-48a0-a084-0cde70e6e36d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:47.577766 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a423d8d9-187e-48a0-a084-0cde70e6e36d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:47.578206 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a423d8d9-187e-48a0-a084-0cde70e6e36d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:47.578968 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a423d8d9-187e-48a0-a084-0cde70e6e36d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:47.579411 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a423d8d9-187e-48a0-a084-0cde70e6e36d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:47.604578 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a423d8d9-187e-48a0-a084-0cde70e6e36d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d/ips" status: 200 len: 149 microversion: 2.1 time: 0.037654 Aug 01 14:23:47.605144 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 289/568] 10.222.0.17 () {58 vars in 1248 bytes} [Mon Aug 1 14:23:47 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:23:47.617165 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3ee25ad5-0580-43f7-92e3-beeb050732a3 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e24bf2e8-2a04-4666-9df8-96cbc917b91f"}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:47.619498 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3ee25ad5-0580-43f7-92e3-beeb050732a3 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:47.626194 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3ee25ad5-0580-43f7-92e3-beeb050732a3 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:47.626638 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3ee25ad5-0580-43f7-92e3-beeb050732a3 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:47.627405 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3ee25ad5-0580-43f7-92e3-beeb050732a3 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:47.627864 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3ee25ad5-0580-43f7-92e3-beeb050732a3 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:47.678247 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f1fc0060-c716-4223-8a3a-7cbfe57840da tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:47.678856 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f1fc0060-c716-4223-8a3a-7cbfe57840da tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:47.687903 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f1fc0060-c716-4223-8a3a-7cbfe57840da tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:47.688654 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f1fc0060-c716-4223-8a3a-7cbfe57840da tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:47.689594 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f1fc0060-c716-4223-8a3a-7cbfe57840da tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:47.690038 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f1fc0060-c716-4223-8a3a-7cbfe57840da tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:47.733476 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-3ee25ad5-0580-43f7-92e3-beeb050732a3 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] HTTP exception thrown: Invalid volume: volume e24bf2e8-2a04-4666-9df8-96cbc917b91f is already attached to instances: fdb50660-a83d-4b80-9be9-f1c264f3d711 Aug 01 14:23:47.737356 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3ee25ad5-0580-43f7-92e3-beeb050732a3 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Request method failure captured: Aug 01 14:23:47.737356 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: POST /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d/os-volume_attachments HTTP/1.1 Aug 01 14:23:47.737356 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:23:47.737356 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:23:47.737356 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:23:47.737356 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 74 Aug 01 14:23:47.737356 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:23:47.737356 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:23:47.737356 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:23:47.737356 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:23:47.737356 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-EkulQUZ9RnUqab4WEJwGiX-pJM7HxTgHalzWuk3LLo8fvk1GbjHf7oAdc4K40oSiRvHm3paXWQHzpNKMP3IF1Z4LwboIgWgWHXBlkSgdewDx_VoBUgWaMnbInPDU7YB5AlXhd0VLng73Y5VTtdj1967GURnhVKliVHkMShTgChU3Y Aug 01 14:23:47.737356 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:23:47.737356 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:23:47.737356 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:23:47.737356 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:23:47.737356 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:23:47.737356 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:23:47.737356 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: 3092982f3c6f4851a5a6e84bf7872d11 Aug 01 14:23:47.737356 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:23:47.737356 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:23:47.737356 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:23:47.738682 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3092982f3c6f4851a5a6e84bf7872d11", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:23:47.738682 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:23:47.738682 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 3092982f3c6f4851a5a6e84bf7872d11 Aug 01 14:23:47.738682 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:23:47.738682 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-AttachVolumeNegativeTest-134821563-project Aug 01 14:23:47.738682 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:23:47.738682 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:23:47.738682 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: 9eda4e19122444cf9cb2b6941adff9d5 Aug 01 14:23:47.738682 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-AttachVolumeNegativeTest-134821563-project Aug 01 14:23:47.738682 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Aug 01 14:23:47.738682 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {"volumeAttachment": {"volumeId": "e24bf2e8-2a04-4666-9df8-96cbc917b91f"}} Aug 01 14:23:47.738682 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: > Aug 01 14:23:47.739394 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Invalid volume: volume e24bf2e8-2a04-4666-9df8-96cbc917b91f is already attached to instances: fdb50660-a83d-4b80-9be9-f1c264f3d711 Aug 01 14:23:47.739394 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'server_id': 'af4ff82b-d3d6-42c8-aeee-186eacd74c9d', 'body': {'volumeAttachment': {'volumeId': 'e24bf2e8-2a04-4666-9df8-96cbc917b91f'}}} Aug 01 14:23:47.739394 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:23:47.739394 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:23:47.739394 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 14:23:47.739394 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 14:23:47.739394 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 14:23:47.739394 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 14:23:47.739394 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 14:23:47.739394 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 14:23:47.739394 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 01 14:23:47.739394 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 01 14:23:47.739394 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 01 14:23:47.739394 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 01 14:23:47.739394 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e24bf2e8-2a04-4666-9df8-96cbc917b91f is already attached to instances: fdb50660-a83d-4b80-9be9-f1c264f3d711 Aug 01 14:23:47.739394 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:23:47.739394 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:23:47.739394 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:23:47.739394 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:23:47.740558 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:23:47.740558 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:23:47.740558 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:23:47.740558 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:23:47.740558 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:23:47.740558 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:23:47.740558 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:23:47.740558 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:23:47.740558 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:23:47.740558 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:23:47.740558 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:23:47.740558 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:23:47.740558 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 01 14:23:47.740558 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 14:23:47.740558 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e24bf2e8-2a04-4666-9df8-96cbc917b91f is already attached to instances: fdb50660-a83d-4b80-9be9-f1c264f3d711 Aug 01 14:23:47.740558 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:23:47.740558 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:23:47.740558 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:23:47.740558 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:23:47.740558 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:23:47.741692 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:23:47.741692 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:23:47.741692 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:23:47.741692 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e24bf2e8-2a04-4666-9df8-96cbc917b91f is already attached to instances: fdb50660-a83d-4b80-9be9-f1c264f3d711 Aug 01 14:23:47.741692 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:23:47.741692 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3ee25ad5-0580-43f7-92e3-beeb050732a3 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Returning 400 to user: Invalid volume: volume e24bf2e8-2a04-4666-9df8-96cbc917b91f is already attached to instances: fdb50660-a83d-4b80-9be9-f1c264f3d711 {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:23:47.741692 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3ee25ad5-0580-43f7-92e3-beeb050732a3 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "POST /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.125825 Aug 01 14:23:47.741692 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 280/569] 10.222.0.17 () {60 vars in 1323 bytes} [Mon Aug 1 14:23:47 2022] POST /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d/os-volume_attachments => generated 174 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:23:47.751432 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5b653be2-c726-45ae-b18a-489b152f33f1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:47.751660 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5b653be2-c726-45ae-b18a-489b152f33f1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:47.758707 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5b653be2-c726-45ae-b18a-489b152f33f1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:47.759147 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5b653be2-c726-45ae-b18a-489b152f33f1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:47.759950 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5b653be2-c726-45ae-b18a-489b152f33f1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:47.760380 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5b653be2-c726-45ae-b18a-489b152f33f1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:47.787068 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5b653be2-c726-45ae-b18a-489b152f33f1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Going to try to terminate instance {{(pid=118133) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:23:47.837019 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f1fc0060-c716-4223-8a3a-7cbfe57840da tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:47.846330 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f1fc0060-c716-4223-8a3a-7cbfe57840da tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1510 microversion: 2.1 time: 0.171867 Aug 01 14:23:47.846915 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 290/570] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:47 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:47.857209 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0159ac07-131e-4b76-9d59-0d7b038e8195 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:47.857813 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0159ac07-131e-4b76-9d59-0d7b038e8195 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:47.871200 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0159ac07-131e-4b76-9d59-0d7b038e8195 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:47.871801 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0159ac07-131e-4b76-9d59-0d7b038e8195 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:47.873020 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0159ac07-131e-4b76-9d59-0d7b038e8195 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:47.873704 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0159ac07-131e-4b76-9d59-0d7b038e8195 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:47.881221 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5b653be2-c726-45ae-b18a-489b152f33f1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "DELETE /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 204 len: 0 microversion: 2.1 time: 0.133214 Aug 01 14:23:47.882435 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 281/571] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Aug 1 14:23:47 2022] DELETE /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 14:23:47.891588 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0d6f05f3-60aa-47a8-9ac9-508bae5d53e4 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:47.892279 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0d6f05f3-60aa-47a8-9ac9-508bae5d53e4 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:47.898234 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0d6f05f3-60aa-47a8-9ac9-508bae5d53e4 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:47.898676 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0d6f05f3-60aa-47a8-9ac9-508bae5d53e4 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:47.899639 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0d6f05f3-60aa-47a8-9ac9-508bae5d53e4 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:47.900017 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0d6f05f3-60aa-47a8-9ac9-508bae5d53e4 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:48.028561 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0159ac07-131e-4b76-9d59-0d7b038e8195 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:48.039983 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0159ac07-131e-4b76-9d59-0d7b038e8195 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:48.041748 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0159ac07-131e-4b76-9d59-0d7b038e8195 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:48.043409 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0159ac07-131e-4b76-9d59-0d7b038e8195 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.190344 Aug 01 14:23:48.044237 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 291/572] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:47 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:48.056194 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0d6f05f3-60aa-47a8-9ac9-508bae5d53e4 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:48.066573 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0d6f05f3-60aa-47a8-9ac9-508bae5d53e4 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 200 len: 1680 microversion: 2.1 time: 0.179551 Aug 01 14:23:48.067157 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 282/573] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:47 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:48.868773 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2cd067ab-6f07-43a3-90af-4c08f945f9f4 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:48.869378 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2cd067ab-6f07-43a3-90af-4c08f945f9f4 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:48.876070 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2cd067ab-6f07-43a3-90af-4c08f945f9f4 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:48.876510 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2cd067ab-6f07-43a3-90af-4c08f945f9f4 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:48.877254 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2cd067ab-6f07-43a3-90af-4c08f945f9f4 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:48.877679 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2cd067ab-6f07-43a3-90af-4c08f945f9f4 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:49.015599 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-2cd067ab-6f07-43a3-90af-4c08f945f9f4 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:49.026218 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2cd067ab-6f07-43a3-90af-4c08f945f9f4 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1516 microversion: 2.1 time: 0.161170 Aug 01 14:23:49.027190 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 292/574] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:48 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:49.066683 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a6341757-d889-4efc-a8ab-cf31872d8205 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:49.068291 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a6341757-d889-4efc-a8ab-cf31872d8205 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:49.075262 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a6341757-d889-4efc-a8ab-cf31872d8205 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:49.075865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a6341757-d889-4efc-a8ab-cf31872d8205 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:49.076633 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a6341757-d889-4efc-a8ab-cf31872d8205 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:49.077064 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a6341757-d889-4efc-a8ab-cf31872d8205 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:49.089043 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ebb6ddf4-74ed-4617-a3fb-3ac0bb37ffce tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:49.089875 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ebb6ddf4-74ed-4617-a3fb-3ac0bb37ffce tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:49.097561 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ebb6ddf4-74ed-4617-a3fb-3ac0bb37ffce tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:49.098179 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ebb6ddf4-74ed-4617-a3fb-3ac0bb37ffce tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:49.099406 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ebb6ddf4-74ed-4617-a3fb-3ac0bb37ffce tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:49.100044 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ebb6ddf4-74ed-4617-a3fb-3ac0bb37ffce tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:49.255743 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ebb6ddf4-74ed-4617-a3fb-3ac0bb37ffce tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:49.259881 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a6341757-d889-4efc-a8ab-cf31872d8205 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:49.266565 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ebb6ddf4-74ed-4617-a3fb-3ac0bb37ffce tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 200 len: 1680 microversion: 2.1 time: 0.181650 Aug 01 14:23:49.267166 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 293/575] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:49 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:49.269922 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a6341757-d889-4efc-a8ab-cf31872d8205 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:49.271472 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a6341757-d889-4efc-a8ab-cf31872d8205 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:49.272631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a6341757-d889-4efc-a8ab-cf31872d8205 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.209973 Aug 01 14:23:49.273178 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 283/576] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:49 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:50.289968 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-95d8d482-4b8b-4db8-9854-d969f618db89 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:50.291283 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-95d8d482-4b8b-4db8-9854-d969f618db89 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:50.299759 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-13e0adbc-663e-4f54-87af-acc4be682e62 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:50.301222 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-13e0adbc-663e-4f54-87af-acc4be682e62 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:50.302681 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-95d8d482-4b8b-4db8-9854-d969f618db89 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:50.303449 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-95d8d482-4b8b-4db8-9854-d969f618db89 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:50.304247 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-95d8d482-4b8b-4db8-9854-d969f618db89 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:50.306427 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-95d8d482-4b8b-4db8-9854-d969f618db89 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:50.315897 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:50.320172 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-13e0adbc-663e-4f54-87af-acc4be682e62 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:50.320969 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-13e0adbc-663e-4f54-87af-acc4be682e62 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:50.322166 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-13e0adbc-663e-4f54-87af-acc4be682e62 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:50.323953 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-13e0adbc-663e-4f54-87af-acc4be682e62 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:50.515647 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-13e0adbc-663e-4f54-87af-acc4be682e62 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:50.536492 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-13e0adbc-663e-4f54-87af-acc4be682e62 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:50.538128 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-13e0adbc-663e-4f54-87af-acc4be682e62 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:50.548932 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-13e0adbc-663e-4f54-87af-acc4be682e62 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.254039 Aug 01 14:23:50.560803 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 284/577] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:50 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:23:50.560803 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3d1a0341-9965-42a7-b452-670b4051ea45 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Action: 'create', calling method: .version_select at 0x7f61854c6430>, body: {"keypair": {"name": "tempest-keypair-1304209833", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBalKG0XWMNBWXkJNaUdyA1puPM4KNRkqQbCB/tKR2O2QyQWsT7SsiDRRJJxgQCXaclA9WAOD3f1b9/jmWhEzRjy0HqYLvLS5hSPXVWZDdBGXTzm8xM5kc5baS/3ENdt3A=="}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:50.601932 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-3d1a0341-9965-42a7-b452-670b4051ea45 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Getting quotas for project 7b6f2af7de6b4e888e702c78f655448a. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:23:50.605788 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-3d1a0341-9965-42a7-b452-670b4051ea45 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Getting quotas for user c487e443eb274090bce842e855b015ec and project 7b6f2af7de6b4e888e702c78f655448a. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:23:50.670731 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-95d8d482-4b8b-4db8-9854-d969f618db89 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:50.678714 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-95d8d482-4b8b-4db8-9854-d969f618db89 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 200 len: 1680 microversion: 2.1 time: 0.393397 Aug 01 14:23:50.681258 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 294/578] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:50 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 1680 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:50.691881 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3d1a0341-9965-42a7-b452-670b4051ea45 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.140041 Aug 01 14:23:50.693593 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 285/579] 10.222.0.17 () {60 vars in 1159 bytes} [Mon Aug 1 14:23:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:23:51.580230 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-76722819-13fa-4f6f-8bf8-feaeccf05d0a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:51.581904 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-76722819-13fa-4f6f-8bf8-feaeccf05d0a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:51.594898 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-76722819-13fa-4f6f-8bf8-feaeccf05d0a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:51.596349 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-76722819-13fa-4f6f-8bf8-feaeccf05d0a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:51.601269 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-76722819-13fa-4f6f-8bf8-feaeccf05d0a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:51.602265 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-76722819-13fa-4f6f-8bf8-feaeccf05d0a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:51.704953 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-fe68284a-876d-487c-be55-21dbdd4a84aa tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:51.705736 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-fe68284a-876d-487c-be55-21dbdd4a84aa tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:51.723157 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fe68284a-876d-487c-be55-21dbdd4a84aa tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:51.723695 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fe68284a-876d-487c-be55-21dbdd4a84aa tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:51.724494 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fe68284a-876d-487c-be55-21dbdd4a84aa tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:51.727125 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fe68284a-876d-487c-be55-21dbdd4a84aa tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:51.950923 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-fe68284a-876d-487c-be55-21dbdd4a84aa tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:51.959263 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-fe68284a-876d-487c-be55-21dbdd4a84aa tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 200 len: 1680 microversion: 2.1 time: 0.260760 Aug 01 14:23:51.972094 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 286/580] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:51 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 1680 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:52.083904 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-76722819-13fa-4f6f-8bf8-feaeccf05d0a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:52.100458 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-76722819-13fa-4f6f-8bf8-feaeccf05d0a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:52.115769 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-76722819-13fa-4f6f-8bf8-feaeccf05d0a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:52.121396 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-76722819-13fa-4f6f-8bf8-feaeccf05d0a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.546591 Aug 01 14:23:52.132445 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 295/581] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:51 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:52.994836 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-cdf1fcda-4f19-4eca-bf5e-9e7a380b7ea8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:53.003045 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-cdf1fcda-4f19-4eca-bf5e-9e7a380b7ea8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:53.038880 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cdf1fcda-4f19-4eca-bf5e-9e7a380b7ea8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:53.044486 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cdf1fcda-4f19-4eca-bf5e-9e7a380b7ea8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:53.052780 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cdf1fcda-4f19-4eca-bf5e-9e7a380b7ea8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:53.058698 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cdf1fcda-4f19-4eca-bf5e-9e7a380b7ea8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:53.163677 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-781af9d4-0f0a-464b-99a9-de382c8be7bc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:53.165078 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-781af9d4-0f0a-464b-99a9-de382c8be7bc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:53.172974 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-781af9d4-0f0a-464b-99a9-de382c8be7bc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:53.174007 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-781af9d4-0f0a-464b-99a9-de382c8be7bc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:53.175109 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-781af9d4-0f0a-464b-99a9-de382c8be7bc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:53.175826 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-781af9d4-0f0a-464b-99a9-de382c8be7bc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:53.257395 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-cdf1fcda-4f19-4eca-bf5e-9e7a380b7ea8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:53.267625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-cdf1fcda-4f19-4eca-bf5e-9e7a380b7ea8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 200 len: 1612 microversion: 2.1 time: 0.285112 Aug 01 14:23:53.269069 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 287/582] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:52 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 1612 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:53.801221 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-781af9d4-0f0a-464b-99a9-de382c8be7bc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:53.810169 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-781af9d4-0f0a-464b-99a9-de382c8be7bc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:53.811747 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-781af9d4-0f0a-464b-99a9-de382c8be7bc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:53.816450 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-781af9d4-0f0a-464b-99a9-de382c8be7bc tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.670117 Aug 01 14:23:53.838761 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 296/583] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:53 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:23:53.955184 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-aaa3ca5b-6337-4a1a-98f6-25dd3eb125c8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1454116998", "imageRef": "9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3dcbd2ec-bb6f-4c0c-8d58-c0c56fbad634"}], "security_groups": [{"name": "tempest-securitygroup--899359289"}], "key_name": "tempest-keypair-1304209833", "user_data": "}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:54.066294 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-e61013dc-61ca-456a-9266-a016a4b2ea0d req-216dbc5c-6c39-4e53-b681-a0b5e7fca991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af4ff82b-d3d6-42c8-aeee-186eacd74c9d", "name": "network-vif-deleted", "tag": "67dc1e44-3667-466f-9a2c-ce4f193e8d0d"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:54.078151 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-e61013dc-61ca-456a-9266-a016a4b2ea0d req-216dbc5c-6c39-4e53-b681-a0b5e7fca991 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:54.079246 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-e61013dc-61ca-456a-9266-a016a4b2ea0d req-216dbc5c-6c39-4e53-b681-a0b5e7fca991 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:54.102137 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-e61013dc-61ca-456a-9266-a016a4b2ea0d req-216dbc5c-6c39-4e53-b681-a0b5e7fca991 service nova] Creating event network-vif-deleted:67dc1e44-3667-466f-9a2c-ce4f193e8d0d for instance af4ff82b-d3d6-42c8-aeee-186eacd74c9d on hv-cinder-84599 Aug 01 14:23:54.108981 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-e61013dc-61ca-456a-9266-a016a4b2ea0d req-216dbc5c-6c39-4e53-b681-a0b5e7fca991 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046655 Aug 01 14:23:54.109741 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 297/584] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:23:54.159402 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.network.neutron [None req-aaa3ca5b-6337-4a1a-98f6-25dd3eb125c8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] validate_networks() for [('3dcbd2ec-bb6f-4c0c-8d58-c0c56fbad634', None, None, None, None, None)] {{(pid=118133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:23:54.297226 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9de205a5-927a-4d73-b478-0eb6f2ffc849 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:54.299221 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9de205a5-927a-4d73-b478-0eb6f2ffc849 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:54.313540 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9de205a5-927a-4d73-b478-0eb6f2ffc849 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:54.314414 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9de205a5-927a-4d73-b478-0eb6f2ffc849 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:54.317954 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9de205a5-927a-4d73-b478-0eb6f2ffc849 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:54.318669 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9de205a5-927a-4d73-b478-0eb6f2ffc849 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:54.452278 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9de205a5-927a-4d73-b478-0eb6f2ffc849 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:54.462041 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9de205a5-927a-4d73-b478-0eb6f2ffc849 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 200 len: 1612 microversion: 2.1 time: 0.173481 Aug 01 14:23:54.470747 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 298/585] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:54 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 1612 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:54.676236 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-aaa3ca5b-6337-4a1a-98f6-25dd3eb125c8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Flavor limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:23:54.676661 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-aaa3ca5b-6337-4a1a-98f6-25dd3eb125c8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Image limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:23:54.677135 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-aaa3ca5b-6337-4a1a-98f6-25dd3eb125c8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Flavor pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:23:54.677538 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-aaa3ca5b-6337-4a1a-98f6-25dd3eb125c8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Image pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:23:54.677959 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-aaa3ca5b-6337-4a1a-98f6-25dd3eb125c8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:23:54.692746 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aaa3ca5b-6337-4a1a-98f6-25dd3eb125c8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:54.701111 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aaa3ca5b-6337-4a1a-98f6-25dd3eb125c8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:54.702341 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aaa3ca5b-6337-4a1a-98f6-25dd3eb125c8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:54.702964 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aaa3ca5b-6337-4a1a-98f6-25dd3eb125c8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:54.747940 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-aaa3ca5b-6337-4a1a-98f6-25dd3eb125c8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Getting quotas for project 7b6f2af7de6b4e888e702c78f655448a. Resources: {'instances', 'cores', 'ram'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:23:54.753812 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-aaa3ca5b-6337-4a1a-98f6-25dd3eb125c8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Getting quotas for user c487e443eb274090bce842e855b015ec and project 7b6f2af7de6b4e888e702c78f655448a. Resources: {'instances', 'cores', 'ram'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:23:54.771170 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-aaa3ca5b-6337-4a1a-98f6-25dd3eb125c8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Going to run 1 instances... {{(pid=118133) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:23:54.774140 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-aaa3ca5b-6337-4a1a-98f6-25dd3eb125c8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:23:54.838188 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-aaa3ca5b-6337-4a1a-98f6-25dd3eb125c8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.889871 Aug 01 14:23:54.839517 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 288/586] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Aug 1 14:23:53 2022] POST /compute/v2.1/servers => generated 408 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:23:54.851715 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4ac8c2c6-c511-4126-b24b-54718632b976 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:54.852657 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4ac8c2c6-c511-4126-b24b-54718632b976 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:54.863108 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ac8c2c6-c511-4126-b24b-54718632b976 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:54.868655 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ac8c2c6-c511-4126-b24b-54718632b976 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:54.870963 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ac8c2c6-c511-4126-b24b-54718632b976 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:54.871714 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ac8c2c6-c511-4126-b24b-54718632b976 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:54.876506 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ba7c6c50-241b-45ea-8c62-b58ee452bb16 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:54.877126 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ba7c6c50-241b-45ea-8c62-b58ee452bb16 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:55.053070 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ba7c6c50-241b-45ea-8c62-b58ee452bb16 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:55.061528 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ba7c6c50-241b-45ea-8c62-b58ee452bb16 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1246 microversion: 2.1 time: 0.201878 Aug 01 14:23:55.078589 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 289/587] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:54 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1246 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:55.189668 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4ac8c2c6-c511-4126-b24b-54718632b976 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:55.199004 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4ac8c2c6-c511-4126-b24b-54718632b976 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:55.200541 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4ac8c2c6-c511-4126-b24b-54718632b976 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:55.205270 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4ac8c2c6-c511-4126-b24b-54718632b976 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.358120 Aug 01 14:23:55.225916 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 299/588] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:54 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:55.490401 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a8d21e56-c61a-4d0d-a42c-d7ec1de8b140 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:55.491838 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a8d21e56-c61a-4d0d-a42c-d7ec1de8b140 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:55.512833 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a8d21e56-c61a-4d0d-a42c-d7ec1de8b140 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:55.513623 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a8d21e56-c61a-4d0d-a42c-d7ec1de8b140 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:55.515779 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a8d21e56-c61a-4d0d-a42c-d7ec1de8b140 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:55.516551 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a8d21e56-c61a-4d0d-a42c-d7ec1de8b140 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:55.645207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a8d21e56-c61a-4d0d-a42c-d7ec1de8b140 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:55.649476 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:55.668536 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a8d21e56-c61a-4d0d-a42c-d7ec1de8b140 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 200 len: 1612 microversion: 2.1 time: 0.185279 Aug 01 14:23:55.672207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 290/589] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:55 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 1612 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:56.085804 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-609f4586-c4d0-4eab-a663-047a5f1bbe6a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:56.086569 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-609f4586-c4d0-4eab-a663-047a5f1bbe6a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:56.107130 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-609f4586-c4d0-4eab-a663-047a5f1bbe6a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:56.107612 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-609f4586-c4d0-4eab-a663-047a5f1bbe6a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:56.109157 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-609f4586-c4d0-4eab-a663-047a5f1bbe6a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:56.109759 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-609f4586-c4d0-4eab-a663-047a5f1bbe6a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:56.145103 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=100 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:56.199421 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-609f4586-c4d0-4eab-a663-047a5f1bbe6a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:56.213478 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-609f4586-c4d0-4eab-a663-047a5f1bbe6a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1242 microversion: 2.1 time: 0.132564 Aug 01 14:23:56.220700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 300/590] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:56 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1242 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:56.233813 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-12c209c5-3a9a-4938-9884-2b2be7b55da7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:56.234401 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-12c209c5-3a9a-4938-9884-2b2be7b55da7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:56.243604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-12c209c5-3a9a-4938-9884-2b2be7b55da7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:56.244243 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-12c209c5-3a9a-4938-9884-2b2be7b55da7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:56.245557 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-12c209c5-3a9a-4938-9884-2b2be7b55da7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:56.246082 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-12c209c5-3a9a-4938-9884-2b2be7b55da7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:56.442146 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-12c209c5-3a9a-4938-9884-2b2be7b55da7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:56.451672 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-12c209c5-3a9a-4938-9884-2b2be7b55da7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:56.453820 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-12c209c5-3a9a-4938-9884-2b2be7b55da7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:56.455097 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-12c209c5-3a9a-4938-9884-2b2be7b55da7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.226000 Aug 01 14:23:56.455769 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 291/591] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:56 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:56.694855 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e3ac9389-d1d2-4cdf-af30-82058d528307 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:56.695525 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e3ac9389-d1d2-4cdf-af30-82058d528307 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:56.706858 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e3ac9389-d1d2-4cdf-af30-82058d528307 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:56.707619 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e3ac9389-d1d2-4cdf-af30-82058d528307 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:56.708733 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e3ac9389-d1d2-4cdf-af30-82058d528307 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:56.710915 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e3ac9389-d1d2-4cdf-af30-82058d528307 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:56.763932 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e3ac9389-d1d2-4cdf-af30-82058d528307 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:56.764779 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e3ac9389-d1d2-4cdf-af30-82058d528307 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:56.765456 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-e3ac9389-d1d2-4cdf-af30-82058d528307 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lazy-loading 'fault' on Instance uuid af4ff82b-d3d6-42c8-aeee-186eacd74c9d {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:23:56.811836 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e3ac9389-d1d2-4cdf-af30-82058d528307 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:56.823170 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e3ac9389-d1d2-4cdf-af30-82058d528307 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 200 len: 1330 microversion: 2.1 time: 0.129912 Aug 01 14:23:56.823837 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 301/592] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:56 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 1330 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:57.243033 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-83f4357f-e5e0-4f97-9130-76378fdcb9b7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:57.243774 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-83f4357f-e5e0-4f97-9130-76378fdcb9b7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:57.260690 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-83f4357f-e5e0-4f97-9130-76378fdcb9b7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:57.261148 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-83f4357f-e5e0-4f97-9130-76378fdcb9b7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:57.261930 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-83f4357f-e5e0-4f97-9130-76378fdcb9b7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:57.262368 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-83f4357f-e5e0-4f97-9130-76378fdcb9b7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:57.340885 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-83f4357f-e5e0-4f97-9130-76378fdcb9b7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:57.352267 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-83f4357f-e5e0-4f97-9130-76378fdcb9b7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1298 microversion: 2.1 time: 0.113693 Aug 01 14:23:57.355608 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 292/593] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:57 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1298 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:57.479297 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b220b930-9888-462f-9182-0e0e6a29213b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:57.480084 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b220b930-9888-462f-9182-0e0e6a29213b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:57.491781 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b220b930-9888-462f-9182-0e0e6a29213b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:57.492431 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b220b930-9888-462f-9182-0e0e6a29213b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:57.493517 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b220b930-9888-462f-9182-0e0e6a29213b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:57.493974 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b220b930-9888-462f-9182-0e0e6a29213b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:57.674400 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b220b930-9888-462f-9182-0e0e6a29213b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:57.686647 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b220b930-9888-462f-9182-0e0e6a29213b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:57.688193 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b220b930-9888-462f-9182-0e0e6a29213b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:57.689386 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b220b930-9888-462f-9182-0e0e6a29213b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.214176 Aug 01 14:23:57.693690 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 302/594] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:57 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:57.846577 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-fd19aace-2dae-4232-948b-e6a63de0d2a8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:57.848021 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-fd19aace-2dae-4232-948b-e6a63de0d2a8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:57.858015 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fd19aace-2dae-4232-948b-e6a63de0d2a8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:57.858547 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fd19aace-2dae-4232-948b-e6a63de0d2a8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:57.859387 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fd19aace-2dae-4232-948b-e6a63de0d2a8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:57.859903 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fd19aace-2dae-4232-948b-e6a63de0d2a8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:57.904729 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fd19aace-2dae-4232-948b-e6a63de0d2a8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:57.905535 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fd19aace-2dae-4232-948b-e6a63de0d2a8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:57.906225 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-fd19aace-2dae-4232-948b-e6a63de0d2a8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lazy-loading 'fault' on Instance uuid af4ff82b-d3d6-42c8-aeee-186eacd74c9d {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:23:57.950572 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-fd19aace-2dae-4232-948b-e6a63de0d2a8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:57.960591 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-fd19aace-2dae-4232-948b-e6a63de0d2a8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 200 len: 1330 microversion: 2.1 time: 0.118073 Aug 01 14:23:57.961725 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 293/595] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:57 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 1330 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:58.373684 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5df22362-d297-45f4-9357-7d1addd421ab tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:58.374430 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5df22362-d297-45f4-9357-7d1addd421ab tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:58.380927 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5df22362-d297-45f4-9357-7d1addd421ab tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:58.381374 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5df22362-d297-45f4-9357-7d1addd421ab tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:58.382164 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5df22362-d297-45f4-9357-7d1addd421ab tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:58.382595 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5df22362-d297-45f4-9357-7d1addd421ab tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:58.453830 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5df22362-d297-45f4-9357-7d1addd421ab tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:58.462847 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5df22362-d297-45f4-9357-7d1addd421ab tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1298 microversion: 2.1 time: 0.092937 Aug 01 14:23:58.463430 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 303/596] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:58 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:58.721217 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-df9c3cbf-58a0-49cd-a09f-bf5d2b19710a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:58.723123 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-df9c3cbf-58a0-49cd-a09f-bf5d2b19710a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:58.742159 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-df9c3cbf-58a0-49cd-a09f-bf5d2b19710a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:58.742868 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-df9c3cbf-58a0-49cd-a09f-bf5d2b19710a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:58.743920 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-df9c3cbf-58a0-49cd-a09f-bf5d2b19710a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:58.744478 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-df9c3cbf-58a0-49cd-a09f-bf5d2b19710a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:58.945716 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-df9c3cbf-58a0-49cd-a09f-bf5d2b19710a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:58.962711 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-df9c3cbf-58a0-49cd-a09f-bf5d2b19710a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:58.964343 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-df9c3cbf-58a0-49cd-a09f-bf5d2b19710a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:58.965751 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-df9c3cbf-58a0-49cd-a09f-bf5d2b19710a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.252881 Aug 01 14:23:58.979658 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 294/597] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:58 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:58.984220 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-385ea584-449c-45f6-8853-18f7fce4b3d8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:58.985352 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-385ea584-449c-45f6-8853-18f7fce4b3d8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:58.997944 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-385ea584-449c-45f6-8853-18f7fce4b3d8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:58.998443 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-385ea584-449c-45f6-8853-18f7fce4b3d8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:58.999794 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-385ea584-449c-45f6-8853-18f7fce4b3d8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:59.000246 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-385ea584-449c-45f6-8853-18f7fce4b3d8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:59.052255 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-385ea584-449c-45f6-8853-18f7fce4b3d8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:59.052988 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-385ea584-449c-45f6-8853-18f7fce4b3d8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:59.053646 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-385ea584-449c-45f6-8853-18f7fce4b3d8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lazy-loading 'fault' on Instance uuid af4ff82b-d3d6-42c8-aeee-186eacd74c9d {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:23:59.111916 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-385ea584-449c-45f6-8853-18f7fce4b3d8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:59.120332 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-385ea584-449c-45f6-8853-18f7fce4b3d8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 200 len: 1330 microversion: 2.1 time: 0.141400 Aug 01 14:23:59.121701 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 304/598] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:58 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 1330 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:59.485110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-62cbfaf6-8b1f-4305-a3ec-673a40445d7a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:59.486021 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-62cbfaf6-8b1f-4305-a3ec-673a40445d7a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:59.493349 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-62cbfaf6-8b1f-4305-a3ec-673a40445d7a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:59.494167 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-62cbfaf6-8b1f-4305-a3ec-673a40445d7a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:59.494949 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-62cbfaf6-8b1f-4305-a3ec-673a40445d7a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:59.495575 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-62cbfaf6-8b1f-4305-a3ec-673a40445d7a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:59.561248 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-62cbfaf6-8b1f-4305-a3ec-673a40445d7a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:59.569694 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-62cbfaf6-8b1f-4305-a3ec-673a40445d7a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1298 microversion: 2.1 time: 0.089045 Aug 01 14:23:59.570975 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 295/599] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:59 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1298 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:00.000591 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-283d6af7-4716-41f9-9145-adc40736dc9e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:00.002770 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-283d6af7-4716-41f9-9145-adc40736dc9e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:00.010872 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-283d6af7-4716-41f9-9145-adc40736dc9e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:00.011318 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-283d6af7-4716-41f9-9145-adc40736dc9e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:00.012176 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-283d6af7-4716-41f9-9145-adc40736dc9e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:00.012614 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-283d6af7-4716-41f9-9145-adc40736dc9e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:00.153547 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f907c444-f48a-42d8-955f-ac6fcdc77c05 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:00.154354 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f907c444-f48a-42d8-955f-ac6fcdc77c05 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:00.167551 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-283d6af7-4716-41f9-9145-adc40736dc9e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:00.169465 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f907c444-f48a-42d8-955f-ac6fcdc77c05 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:00.172477 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f907c444-f48a-42d8-955f-ac6fcdc77c05 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:00.173628 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f907c444-f48a-42d8-955f-ac6fcdc77c05 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:00.174523 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f907c444-f48a-42d8-955f-ac6fcdc77c05 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:00.178844 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-283d6af7-4716-41f9-9145-adc40736dc9e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:00.180760 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-283d6af7-4716-41f9-9145-adc40736dc9e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:00.182384 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-283d6af7-4716-41f9-9145-adc40736dc9e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1809 microversion: 2.20 time: 0.189873 Aug 01 14:24:00.183241 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 305/600] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:59 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:24:00.234705 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f907c444-f48a-42d8-955f-ac6fcdc77c05 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:00.235050 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f907c444-f48a-42d8-955f-ac6fcdc77c05 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:00.236042 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-f907c444-f48a-42d8-955f-ac6fcdc77c05 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lazy-loading 'fault' on Instance uuid af4ff82b-d3d6-42c8-aeee-186eacd74c9d {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:24:00.294733 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f907c444-f48a-42d8-955f-ac6fcdc77c05 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:00.305180 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f907c444-f48a-42d8-955f-ac6fcdc77c05 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 200 len: 1330 microversion: 2.1 time: 0.156494 Aug 01 14:24:00.307400 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 296/601] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:00 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 1330 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:00.590777 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e3745e8c-51ca-4b57-a77a-0a714310e8b6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:00.591308 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e3745e8c-51ca-4b57-a77a-0a714310e8b6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:00.602576 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e3745e8c-51ca-4b57-a77a-0a714310e8b6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:00.603538 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e3745e8c-51ca-4b57-a77a-0a714310e8b6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:00.604928 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e3745e8c-51ca-4b57-a77a-0a714310e8b6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:00.608004 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e3745e8c-51ca-4b57-a77a-0a714310e8b6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:00.698420 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e3745e8c-51ca-4b57-a77a-0a714310e8b6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:00.722231 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e3745e8c-51ca-4b57-a77a-0a714310e8b6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1306 microversion: 2.1 time: 0.135832 Aug 01 14:24:00.727404 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 306/602] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:00 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1306 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:01.206996 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-395188d9-d0f6-4ee3-8f09-2f5341a311a4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:01.207720 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-395188d9-d0f6-4ee3-8f09-2f5341a311a4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:01.214622 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-395188d9-d0f6-4ee3-8f09-2f5341a311a4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:01.215154 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-395188d9-d0f6-4ee3-8f09-2f5341a311a4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:01.216175 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-395188d9-d0f6-4ee3-8f09-2f5341a311a4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:01.216824 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-395188d9-d0f6-4ee3-8f09-2f5341a311a4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:01.332391 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-bf57935f-0cd4-4419-8dc2-537636deb373 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:01.335482 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-bf57935f-0cd4-4419-8dc2-537636deb373 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:01.345935 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bf57935f-0cd4-4419-8dc2-537636deb373 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:01.347500 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bf57935f-0cd4-4419-8dc2-537636deb373 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:01.348722 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bf57935f-0cd4-4419-8dc2-537636deb373 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:01.349403 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bf57935f-0cd4-4419-8dc2-537636deb373 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:01.368250 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-bf57935f-0cd4-4419-8dc2-537636deb373 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] HTTP exception thrown: Instance af4ff82b-d3d6-42c8-aeee-186eacd74c9d could not be found. Aug 01 14:24:01.370530 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-bf57935f-0cd4-4419-8dc2-537636deb373 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Request method failure captured: Aug 01 14:24:01.370530 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d HTTP/1.1 Aug 01 14:24:01.370530 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept: application/json Aug 01 14:24:01.370530 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Aug 01 14:24:01.370530 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Connection: close Aug 01 14:24:01.370530 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Length: 0 Aug 01 14:24:01.370530 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Type: application/json Aug 01 14:24:01.370530 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Host: 10.222.0.17 Aug 01 14:24:01.370530 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Aug 01 14:24:01.370530 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.10 Aug 01 14:24:01.370530 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABi5-EkulQUZ9RnUqab4WEJwGiX-pJM7HxTgHalzWuk3LLo8fvk1GbjHf7oAdc4K40oSiRvHm3paXWQHzpNKMP3IF1Z4LwboIgWgWHXBlkSgdewDx_VoBUgWaMnbInPDU7YB5AlXhd0VLng73Y5VTtdj1967GURnhVKliVHkMShTgChU3Y Aug 01 14:24:01.370530 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Aug 01 14:24:01.370530 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Aug 01 14:24:01.370530 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Aug 01 14:24:01.370530 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Aug 01 14:24:01.370530 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Aug 01 14:24:01.370530 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Aug 01 14:24:01.370530 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Id: 3092982f3c6f4851a5a6e84bf7872d11 Aug 01 14:24:01.370530 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:24:01.370530 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Role: reader,member Aug 01 14:24:01.370530 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Roles: reader,member Aug 01 14:24:01.372177 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3092982f3c6f4851a5a6e84bf7872d11", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:24:01.372177 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:24:01.372177 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 3092982f3c6f4851a5a6e84bf7872d11 Aug 01 14:24:01.372177 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:24:01.372177 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User: tempest-AttachVolumeNegativeTest-134821563-project Aug 01 14:24:01.372177 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Aug 01 14:24:01.372177 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Aug 01 14:24:01.372177 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Id: 9eda4e19122444cf9cb2b6941adff9d5 Aug 01 14:24:01.372177 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-AttachVolumeNegativeTest-134821563-project Aug 01 14:24:01.372177 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: method: > Aug 01 14:24:01.372177 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: exception: Instance af4ff82b-d3d6-42c8-aeee-186eacd74c9d could not be found. Aug 01 14:24:01.372177 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: action_args: {'id': 'af4ff82b-d3d6-42c8-aeee-186eacd74c9d'} Aug 01 14:24:01.373170 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:24:01.373170 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:24:01.373170 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:24:01.373170 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:24:01.373170 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:24:01.373170 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:24:01.373170 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:24:01.373170 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:24:01.373170 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:24:01.373170 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:24:01.373170 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af4ff82b-d3d6-42c8-aeee-186eacd74c9d could not be found. Aug 01 14:24:01.373170 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:24:01.373170 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:24:01.373170 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:24:01.373170 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:24:01.373170 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:24:01.373170 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:24:01.373170 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:24:01.373170 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:24:01.373170 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:24:01.374575 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:24:01.374575 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:24:01.374575 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:24:01.374575 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:24:01.374575 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:24:01.374575 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:24:01.374575 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:24:01.374575 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af4ff82b-d3d6-42c8-aeee-186eacd74c9d could not be found. Aug 01 14:24:01.374575 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:24:01.374575 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:24:01.374575 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:24:01.374575 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:24:01.374575 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:24:01.374575 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:24:01.374575 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:24:01.374575 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:24:01.374575 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af4ff82b-d3d6-42c8-aeee-186eacd74c9d could not be found. Aug 01 14:24:01.374575 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:24:01.378445 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-bf57935f-0cd4-4419-8dc2-537636deb373 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Returning 404 to user: Instance af4ff82b-d3d6-42c8-aeee-186eacd74c9d could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:24:01.379774 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-bf57935f-0cd4-4419-8dc2-537636deb373 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 404 len: 111 microversion: 2.1 time: 0.054694 Aug 01 14:24:01.380742 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 307/603] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:01 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 14:24:01.395363 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-146cfb8f-bc0c-427b-bd5e-123ed842f92f tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '.version_select at 0x7f6184bef9d0>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:01.404217 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-395188d9-d0f6-4ee3-8f09-2f5341a311a4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:01.417205 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-395188d9-d0f6-4ee3-8f09-2f5341a311a4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:01.419084 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-395188d9-d0f6-4ee3-8f09-2f5341a311a4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:01.420668 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-395188d9-d0f6-4ee3-8f09-2f5341a311a4 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1796 microversion: 2.20 time: 0.217758 Aug 01 14:24:01.421739 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 297/604] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:01 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1796 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:01.446574 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-146cfb8f-bc0c-427b-bd5e-123ed842f92f tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-351306984" status: 202 len: 0 microversion: 2.1 time: 0.061362 Aug 01 14:24:01.447864 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 308/605] 10.222.0.17 () {58 vars in 1218 bytes} [Mon Aug 1 14:24:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-351306984 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:24:01.753621 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-eb22939f-3040-4268-962b-0c0fe79c4372 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:01.754669 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-eb22939f-3040-4268-962b-0c0fe79c4372 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:01.766641 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-eb22939f-3040-4268-962b-0c0fe79c4372 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:01.767099 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-eb22939f-3040-4268-962b-0c0fe79c4372 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:01.775596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-eb22939f-3040-4268-962b-0c0fe79c4372 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:01.776063 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-eb22939f-3040-4268-962b-0c0fe79c4372 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:02.325939 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-eb22939f-3040-4268-962b-0c0fe79c4372 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:02.335033 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-eb22939f-3040-4268-962b-0c0fe79c4372 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1371 microversion: 2.1 time: 0.586364 Aug 01 14:24:02.339341 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 298/606] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:01 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1371 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:02.748589 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-12d64227-8699-49a3-9cca-ed95751639d4 req-69da9a2a-b95c-43f5-bc8a-eaad296300ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5664fd60-279c-4671-9a77-a5bc99baf7be", "tag": "2898c3ea-4ab0-4c5f-9813-8db5fcaa5a1d"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:24:02.822771 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-12d64227-8699-49a3-9cca-ed95751639d4 req-69da9a2a-b95c-43f5-bc8a-eaad296300ab service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:02.828846 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-12d64227-8699-49a3-9cca-ed95751639d4 req-69da9a2a-b95c-43f5-bc8a-eaad296300ab service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:02.846034 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-12d64227-8699-49a3-9cca-ed95751639d4 req-69da9a2a-b95c-43f5-bc8a-eaad296300ab service nova] Creating event network-changed:2898c3ea-4ab0-4c5f-9813-8db5fcaa5a1d for instance 5664fd60-279c-4671-9a77-a5bc99baf7be on hv-cinder-84599 Aug 01 14:24:02.853078 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-12d64227-8699-49a3-9cca-ed95751639d4 req-69da9a2a-b95c-43f5-bc8a-eaad296300ab service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122229 Aug 01 14:24:02.854293 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 309/607] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:24:03.021036 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-cbbb4e97-8328-44dc-b2be-cf88ba3a7b5f tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:03.021666 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-cbbb4e97-8328-44dc-b2be-cf88ba3a7b5f tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:03.028491 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cbbb4e97-8328-44dc-b2be-cf88ba3a7b5f tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:03.029321 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cbbb4e97-8328-44dc-b2be-cf88ba3a7b5f tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:03.031012 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cbbb4e97-8328-44dc-b2be-cf88ba3a7b5f tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:03.031700 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cbbb4e97-8328-44dc-b2be-cf88ba3a7b5f tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:03.216697 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-cbbb4e97-8328-44dc-b2be-cf88ba3a7b5f tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lazy-loading 'services' on Instance uuid fdb50660-a83d-4b80-9be9-f1c264f3d711 {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:24:03.368436 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5a508096-da6c-4ad9-aa54-606fd77a9421 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:03.369467 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5a508096-da6c-4ad9-aa54-606fd77a9421 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:03.369999 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-cbbb4e97-8328-44dc-b2be-cf88ba3a7b5f tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711/os-volume_attachments/e24bf2e8-2a04-4666-9df8-96cbc917b91f" status: 202 len: 0 microversion: 2.1 time: 0.351797 Aug 01 14:24:03.375097 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 299/608] 10.222.0.17 () {58 vars in 1416 bytes} [Mon Aug 1 14:24:03 2022] DELETE /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711/os-volume_attachments/e24bf2e8-2a04-4666-9df8-96cbc917b91f => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:24:03.382464 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e5228dd7-65c4-4d97-beb2-eb79327de62b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:03.385808 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5a508096-da6c-4ad9-aa54-606fd77a9421 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:03.386251 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e5228dd7-65c4-4d97-beb2-eb79327de62b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:03.386855 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5a508096-da6c-4ad9-aa54-606fd77a9421 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:03.387823 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5a508096-da6c-4ad9-aa54-606fd77a9421 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:03.389485 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5a508096-da6c-4ad9-aa54-606fd77a9421 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:03.395330 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e5228dd7-65c4-4d97-beb2-eb79327de62b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:03.395886 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e5228dd7-65c4-4d97-beb2-eb79327de62b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:03.397318 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e5228dd7-65c4-4d97-beb2-eb79327de62b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:03.398269 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e5228dd7-65c4-4d97-beb2-eb79327de62b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:03.469512 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e5228dd7-65c4-4d97-beb2-eb79327de62b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092630 Aug 01 14:24:03.470024 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 300/609] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Aug 1 14:24:03 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:24:03.566835 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5a508096-da6c-4ad9-aa54-606fd77a9421 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:03.583560 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5a508096-da6c-4ad9-aa54-606fd77a9421 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1371 microversion: 2.1 time: 0.221390 Aug 01 14:24:03.599653 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 310/610] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:03 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:04.312046 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-46ba1f6b-1366-4943-a501-2bb89e6d2a06 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:04.312773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-46ba1f6b-1366-4943-a501-2bb89e6d2a06 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:04.321298 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-46ba1f6b-1366-4943-a501-2bb89e6d2a06 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:04.321777 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-46ba1f6b-1366-4943-a501-2bb89e6d2a06 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:04.322716 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-46ba1f6b-1366-4943-a501-2bb89e6d2a06 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:04.323149 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-46ba1f6b-1366-4943-a501-2bb89e6d2a06 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:04.447311 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-46ba1f6b-1366-4943-a501-2bb89e6d2a06 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lazy-loading 'services' on Instance uuid 99c8a6ff-979f-488e-8ea7-43158ba0570a {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:24:04.483114 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ea423397-1f4f-42a3-bf26-765894f85eae tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:04.485812 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ea423397-1f4f-42a3-bf26-765894f85eae tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:04.512537 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ea423397-1f4f-42a3-bf26-765894f85eae tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:04.514724 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ea423397-1f4f-42a3-bf26-765894f85eae tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:04.520855 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ea423397-1f4f-42a3-bf26-765894f85eae tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:04.524573 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ea423397-1f4f-42a3-bf26-765894f85eae tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:04.553782 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-46ba1f6b-1366-4943-a501-2bb89e6d2a06 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "DELETE /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a/os-volume_attachments/96bb8d36-b49f-4195-911d-50a1b0349b9a" status: 202 len: 0 microversion: 2.1 time: 0.246005 Aug 01 14:24:04.555010 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 301/611] 10.222.0.17 () {58 vars in 1416 bytes} [Mon Aug 1 14:24:04 2022] DELETE /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a/os-volume_attachments/96bb8d36-b49f-4195-911d-50a1b0349b9a => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 14:24:04.621446 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-11ed2a09-0205-4e17-97cd-196f0d4f3761 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:04.624180 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-11ed2a09-0205-4e17-97cd-196f0d4f3761 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:04.634232 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ea423397-1f4f-42a3-bf26-765894f85eae tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156368 Aug 01 14:24:04.638439 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 311/612] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Aug 1 14:24:04 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:24:04.650059 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-11ed2a09-0205-4e17-97cd-196f0d4f3761 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:04.652648 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-11ed2a09-0205-4e17-97cd-196f0d4f3761 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:04.653594 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-11ed2a09-0205-4e17-97cd-196f0d4f3761 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:04.655081 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-11ed2a09-0205-4e17-97cd-196f0d4f3761 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:04.711344 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:04.840146 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-11ed2a09-0205-4e17-97cd-196f0d4f3761 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:04.850423 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-11ed2a09-0205-4e17-97cd-196f0d4f3761 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1371 microversion: 2.1 time: 0.243281 Aug 01 14:24:04.851541 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 302/613] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:04 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:05.653705 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-22ad70d0-9e31-4b03-9871-01bd4347ea50 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:05.667832 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-22ad70d0-9e31-4b03-9871-01bd4347ea50 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:05.682201 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-22ad70d0-9e31-4b03-9871-01bd4347ea50 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:05.683737 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-22ad70d0-9e31-4b03-9871-01bd4347ea50 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:05.685877 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-22ad70d0-9e31-4b03-9871-01bd4347ea50 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:05.687131 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-22ad70d0-9e31-4b03-9871-01bd4347ea50 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:05.750062 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-22ad70d0-9e31-4b03-9871-01bd4347ea50 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102094 Aug 01 14:24:05.751524 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 312/614] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Aug 1 14:24:05 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:24:05.875000 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-79c1bdbb-25d6-45e2-bf15-26b54aacea61 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:05.876455 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-79c1bdbb-25d6-45e2-bf15-26b54aacea61 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:05.878637 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=12 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:05.886134 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-79c1bdbb-25d6-45e2-bf15-26b54aacea61 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:05.886700 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-79c1bdbb-25d6-45e2-bf15-26b54aacea61 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:05.887671 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-79c1bdbb-25d6-45e2-bf15-26b54aacea61 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:05.888262 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-79c1bdbb-25d6-45e2-bf15-26b54aacea61 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:06.099715 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-79c1bdbb-25d6-45e2-bf15-26b54aacea61 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:06.110200 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-79c1bdbb-25d6-45e2-bf15-26b54aacea61 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1371 microversion: 2.1 time: 0.240587 Aug 01 14:24:06.112353 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 303/615] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:05 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:06.763496 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b83b8bb2-b4ed-4567-870b-05261673a774 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:06.766379 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b83b8bb2-b4ed-4567-870b-05261673a774 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:06.773809 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b83b8bb2-b4ed-4567-870b-05261673a774 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:06.774473 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b83b8bb2-b4ed-4567-870b-05261673a774 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:06.775615 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b83b8bb2-b4ed-4567-870b-05261673a774 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:06.776383 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b83b8bb2-b4ed-4567-870b-05261673a774 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:06.814656 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b83b8bb2-b4ed-4567-870b-05261673a774 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055827 Aug 01 14:24:06.815601 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 313/616] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Aug 1 14:24:06 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:24:06.845709 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-667a7e1a-7d8d-4279-bad6-0ccd1b2c5718 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:06.846224 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-667a7e1a-7d8d-4279-bad6-0ccd1b2c5718 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:06.854286 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-667a7e1a-7d8d-4279-bad6-0ccd1b2c5718 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:06.854668 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-667a7e1a-7d8d-4279-bad6-0ccd1b2c5718 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:06.855560 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-667a7e1a-7d8d-4279-bad6-0ccd1b2c5718 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:06.856065 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-667a7e1a-7d8d-4279-bad6-0ccd1b2c5718 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:06.904953 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-242be20a-0b44-4724-b5e0-bcb778dc0013 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:06.904953 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-242be20a-0b44-4724-b5e0-bcb778dc0013 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:06.905410 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-242be20a-0b44-4724-b5e0-bcb778dc0013 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:06.907678 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-242be20a-0b44-4724-b5e0-bcb778dc0013 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:06.907678 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-242be20a-0b44-4724-b5e0-bcb778dc0013 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:06.907678 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-242be20a-0b44-4724-b5e0-bcb778dc0013 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:06.922638 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-667a7e1a-7d8d-4279-bad6-0ccd1b2c5718 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Going to try to terminate instance {{(pid=118133) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:24:06.941240 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-242be20a-0b44-4724-b5e0-bcb778dc0013 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Going to try to terminate instance {{(pid=118132) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:24:06.981133 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:07.067963 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-667a7e1a-7d8d-4279-bad6-0ccd1b2c5718 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "DELETE /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 204 len: 0 microversion: 2.1 time: 0.227256 Aug 01 14:24:07.073430 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 304/617] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Aug 1 14:24:06 2022] DELETE /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:24:07.077328 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-242be20a-0b44-4724-b5e0-bcb778dc0013 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 204 len: 0 microversion: 2.1 time: 0.187847 Aug 01 14:24:07.078971 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 314/618] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Aug 1 14:24:06 2022] DELETE /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:24:07.079295 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-23ba14f3-2083-4dea-9e17-0e23e53edf71 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:07.080156 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-23ba14f3-2083-4dea-9e17-0e23e53edf71 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:07.088664 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-23ba14f3-2083-4dea-9e17-0e23e53edf71 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:07.089173 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-23ba14f3-2083-4dea-9e17-0e23e53edf71 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:07.090010 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-23ba14f3-2083-4dea-9e17-0e23e53edf71 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:07.090427 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-23ba14f3-2083-4dea-9e17-0e23e53edf71 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:07.091077 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3b556b2d-1228-4ff1-b388-16c838cfec57 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:07.092459 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3b556b2d-1228-4ff1-b388-16c838cfec57 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:07.100619 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3b556b2d-1228-4ff1-b388-16c838cfec57 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:07.101397 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3b556b2d-1228-4ff1-b388-16c838cfec57 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:07.102844 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3b556b2d-1228-4ff1-b388-16c838cfec57 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:07.103712 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3b556b2d-1228-4ff1-b388-16c838cfec57 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:07.257456 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-23ba14f3-2083-4dea-9e17-0e23e53edf71 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:07.267320 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-23ba14f3-2083-4dea-9e17-0e23e53edf71 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1513 microversion: 2.1 time: 0.192880 Aug 01 14:24:07.279483 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 305/619] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:07 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:07.279721 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3b556b2d-1228-4ff1-b388-16c838cfec57 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:07.279840 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d2e8d1b7-8ddd-400f-9dd6-d6848159e5e7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:07.279840 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d2e8d1b7-8ddd-400f-9dd6-d6848159e5e7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:07.280015 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3b556b2d-1228-4ff1-b388-16c838cfec57 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1681 microversion: 2.1 time: 0.193096 Aug 01 14:24:07.280015 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 315/620] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:07 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1681 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:07.280191 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d2e8d1b7-8ddd-400f-9dd6-d6848159e5e7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:07.280633 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d2e8d1b7-8ddd-400f-9dd6-d6848159e5e7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:07.282877 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d2e8d1b7-8ddd-400f-9dd6-d6848159e5e7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:07.282877 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d2e8d1b7-8ddd-400f-9dd6-d6848159e5e7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:07.443876 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d2e8d1b7-8ddd-400f-9dd6-d6848159e5e7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:07.452250 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d2e8d1b7-8ddd-400f-9dd6-d6848159e5e7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1371 microversion: 2.1 time: 0.183074 Aug 01 14:24:07.453144 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 306/621] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:07 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:08.290347 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6d45f65c-e623-4b60-9a62-f9f0a55e888b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:08.291122 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-6d45f65c-e623-4b60-9a62-f9f0a55e888b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:08.297866 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6d45f65c-e623-4b60-9a62-f9f0a55e888b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:08.298362 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6d45f65c-e623-4b60-9a62-f9f0a55e888b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:08.299026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6d45f65c-e623-4b60-9a62-f9f0a55e888b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:08.299479 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6d45f65c-e623-4b60-9a62-f9f0a55e888b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:08.302004 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c819f944-bded-49b2-aaac-1a8d3846e7dd tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:08.302643 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c819f944-bded-49b2-aaac-1a8d3846e7dd tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:08.309410 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c819f944-bded-49b2-aaac-1a8d3846e7dd tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:08.309997 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c819f944-bded-49b2-aaac-1a8d3846e7dd tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:08.311403 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c819f944-bded-49b2-aaac-1a8d3846e7dd tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:08.311951 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c819f944-bded-49b2-aaac-1a8d3846e7dd tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:08.449369 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6d45f65c-e623-4b60-9a62-f9f0a55e888b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:08.454275 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c819f944-bded-49b2-aaac-1a8d3846e7dd tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:08.458053 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6d45f65c-e623-4b60-9a62-f9f0a55e888b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1513 microversion: 2.1 time: 0.171589 Aug 01 14:24:08.458641 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 316/622] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:08 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:08.462017 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c819f944-bded-49b2-aaac-1a8d3846e7dd tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1681 microversion: 2.1 time: 0.164347 Aug 01 14:24:08.462586 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 307/623] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:08 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:24:08.473305 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c2fd8e9a-7a89-49a3-973a-0cc5adf47417 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:08.473912 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c2fd8e9a-7a89-49a3-973a-0cc5adf47417 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:08.475867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:08.481234 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c2fd8e9a-7a89-49a3-973a-0cc5adf47417 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:08.481683 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c2fd8e9a-7a89-49a3-973a-0cc5adf47417 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:08.482478 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c2fd8e9a-7a89-49a3-973a-0cc5adf47417 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:08.482910 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c2fd8e9a-7a89-49a3-973a-0cc5adf47417 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:08.487777 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:08.616184 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c2fd8e9a-7a89-49a3-973a-0cc5adf47417 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:08.624198 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c2fd8e9a-7a89-49a3-973a-0cc5adf47417 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1371 microversion: 2.1 time: 0.155169 Aug 01 14:24:08.624739 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 317/624] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:08 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:09.480206 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-96622faa-0e05-4c0d-b12d-84f8530c43e8 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:09.481359 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-96622faa-0e05-4c0d-b12d-84f8530c43e8 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:09.483822 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4c5d7f50-530d-4242-a23f-51b901d379df tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:09.484504 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4c5d7f50-530d-4242-a23f-51b901d379df tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:09.488711 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-96622faa-0e05-4c0d-b12d-84f8530c43e8 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:09.489203 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-96622faa-0e05-4c0d-b12d-84f8530c43e8 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:09.489978 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-96622faa-0e05-4c0d-b12d-84f8530c43e8 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:09.490402 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-96622faa-0e05-4c0d-b12d-84f8530c43e8 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:09.491362 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4c5d7f50-530d-4242-a23f-51b901d379df tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:09.491857 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4c5d7f50-530d-4242-a23f-51b901d379df tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:09.492803 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4c5d7f50-530d-4242-a23f-51b901d379df tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:09.493632 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4c5d7f50-530d-4242-a23f-51b901d379df tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:09.643212 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4c5d7f50-530d-4242-a23f-51b901d379df tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:09.654000 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4c5d7f50-530d-4242-a23f-51b901d379df tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1681 microversion: 2.1 time: 0.174130 Aug 01 14:24:09.655146 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 318/625] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:09 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:09.666839 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-bac13201-c8b7-482e-a12a-a8934309fc2f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:09.671795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-bac13201-c8b7-482e-a12a-a8934309fc2f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:09.680029 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bac13201-c8b7-482e-a12a-a8934309fc2f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:09.680482 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bac13201-c8b7-482e-a12a-a8934309fc2f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:09.681282 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bac13201-c8b7-482e-a12a-a8934309fc2f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:09.681721 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bac13201-c8b7-482e-a12a-a8934309fc2f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:09.689493 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-96622faa-0e05-4c0d-b12d-84f8530c43e8 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:09.697554 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-96622faa-0e05-4c0d-b12d-84f8530c43e8 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1513 microversion: 2.1 time: 0.221343 Aug 01 14:24:09.698683 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 308/626] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:09 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1513 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:09.823134 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-c0b09330-5929-425b-9be0-c5c5e8053478 req-2e819f3e-5fa5-4453-bba9-ad8d0eea444d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5664fd60-279c-4671-9a77-a5bc99baf7be", "name": "network-vif-plugged", "status": "completed", "tag": "2898c3ea-4ab0-4c5f-9813-8db5fcaa5a1d"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:24:09.833599 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-c0b09330-5929-425b-9be0-c5c5e8053478 req-2e819f3e-5fa5-4453-bba9-ad8d0eea444d service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:09.834054 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-c0b09330-5929-425b-9be0-c5c5e8053478 req-2e819f3e-5fa5-4453-bba9-ad8d0eea444d service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:09.843370 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-bac13201-c8b7-482e-a12a-a8934309fc2f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:09.846140 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-c0b09330-5929-425b-9be0-c5c5e8053478 req-2e819f3e-5fa5-4453-bba9-ad8d0eea444d service nova] Creating event network-vif-plugged:2898c3ea-4ab0-4c5f-9813-8db5fcaa5a1d for instance 5664fd60-279c-4671-9a77-a5bc99baf7be on hv-cinder-84599 Aug 01 14:24:09.851032 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-c0b09330-5929-425b-9be0-c5c5e8053478 req-2e819f3e-5fa5-4453-bba9-ad8d0eea444d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031819 Aug 01 14:24:09.851774 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-bac13201-c8b7-482e-a12a-a8934309fc2f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1371 microversion: 2.1 time: 0.195235 Aug 01 14:24:09.852034 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 309/627] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:24:09.852566 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 319/628] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:09 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:10.677208 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9aac5363-b338-4dd3-9f22-514852b653b2 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:10.677911 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9aac5363-b338-4dd3-9f22-514852b653b2 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:10.684096 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9aac5363-b338-4dd3-9f22-514852b653b2 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:10.684530 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9aac5363-b338-4dd3-9f22-514852b653b2 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:10.685308 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9aac5363-b338-4dd3-9f22-514852b653b2 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:10.685733 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9aac5363-b338-4dd3-9f22-514852b653b2 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:10.720885 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-463535df-04df-45ba-96a5-b7e9ade6cddc tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:10.721495 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-463535df-04df-45ba-96a5-b7e9ade6cddc tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:10.728441 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-463535df-04df-45ba-96a5-b7e9ade6cddc tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:10.728864 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-463535df-04df-45ba-96a5-b7e9ade6cddc tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:10.729643 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-463535df-04df-45ba-96a5-b7e9ade6cddc tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:10.730076 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-463535df-04df-45ba-96a5-b7e9ade6cddc tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:10.826358 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9aac5363-b338-4dd3-9f22-514852b653b2 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:10.840473 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9aac5363-b338-4dd3-9f22-514852b653b2 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1681 microversion: 2.1 time: 0.167575 Aug 01 14:24:10.845353 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 310/629] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:10 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:10.872770 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-972f77ef-a70e-4b11-b33c-3594f36d9788 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:10.873368 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-972f77ef-a70e-4b11-b33c-3594f36d9788 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:10.880704 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-463535df-04df-45ba-96a5-b7e9ade6cddc tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:10.880905 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-972f77ef-a70e-4b11-b33c-3594f36d9788 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:10.881509 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-972f77ef-a70e-4b11-b33c-3594f36d9788 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:10.882449 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-972f77ef-a70e-4b11-b33c-3594f36d9788 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:10.882880 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-972f77ef-a70e-4b11-b33c-3594f36d9788 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:10.888231 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-463535df-04df-45ba-96a5-b7e9ade6cddc tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1513 microversion: 2.1 time: 0.171557 Aug 01 14:24:10.888807 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 320/630] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:10 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:24:11.148767 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-972f77ef-a70e-4b11-b33c-3594f36d9788 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:11.157344 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-972f77ef-a70e-4b11-b33c-3594f36d9788 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1371 microversion: 2.1 time: 0.288651 Aug 01 14:24:11.158457 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 311/631] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:10 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1371 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:11.862916 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-82fa6d78-9cc9-4fcc-9fac-cc768b244c5c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:11.864153 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-82fa6d78-9cc9-4fcc-9fac-cc768b244c5c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:11.870976 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-82fa6d78-9cc9-4fcc-9fac-cc768b244c5c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:11.871746 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-82fa6d78-9cc9-4fcc-9fac-cc768b244c5c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:11.872712 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-82fa6d78-9cc9-4fcc-9fac-cc768b244c5c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:11.873149 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-82fa6d78-9cc9-4fcc-9fac-cc768b244c5c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:11.913664 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-90efa14f-4adf-4500-bb6a-f0da07539e5b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:11.914483 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-90efa14f-4adf-4500-bb6a-f0da07539e5b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:11.925272 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-90efa14f-4adf-4500-bb6a-f0da07539e5b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:11.925272 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-90efa14f-4adf-4500-bb6a-f0da07539e5b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:11.925681 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-90efa14f-4adf-4500-bb6a-f0da07539e5b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:11.926558 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-90efa14f-4adf-4500-bb6a-f0da07539e5b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:12.091496 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-90efa14f-4adf-4500-bb6a-f0da07539e5b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:12.100769 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-90efa14f-4adf-4500-bb6a-f0da07539e5b tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1513 microversion: 2.1 time: 0.193703 Aug 01 14:24:12.101545 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 312/632] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:11 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:12.178419 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f214fbbe-b6f7-40a6-b3a4-614a0dcc4879 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:12.179511 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f214fbbe-b6f7-40a6-b3a4-614a0dcc4879 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:12.186433 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f214fbbe-b6f7-40a6-b3a4-614a0dcc4879 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:12.187197 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f214fbbe-b6f7-40a6-b3a4-614a0dcc4879 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:12.188363 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f214fbbe-b6f7-40a6-b3a4-614a0dcc4879 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:12.189053 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f214fbbe-b6f7-40a6-b3a4-614a0dcc4879 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:12.281770 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-82fa6d78-9cc9-4fcc-9fac-cc768b244c5c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:12.297452 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-82fa6d78-9cc9-4fcc-9fac-cc768b244c5c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1681 microversion: 2.1 time: 0.438314 Aug 01 14:24:12.303542 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 321/633] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:11 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1681 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:12.430236 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f214fbbe-b6f7-40a6-b3a4-614a0dcc4879 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:12.437811 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-b8f15424-73ae-4262-b2e0-7838f1603041 req-1579619b-3229-49db-ad30-9daa58dd6d87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c8a6ff-979f-488e-8ea7-43158ba0570a", "name": "network-vif-deleted", "tag": "3958ac7c-4615-4de4-ac54-06e8a6e50ac7"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:24:12.439887 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f214fbbe-b6f7-40a6-b3a4-614a0dcc4879 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1371 microversion: 2.1 time: 0.265389 Aug 01 14:24:12.448010 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-b8f15424-73ae-4262-b2e0-7838f1603041 req-1579619b-3229-49db-ad30-9daa58dd6d87 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:12.448571 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-b8f15424-73ae-4262-b2e0-7838f1603041 req-1579619b-3229-49db-ad30-9daa58dd6d87 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:12.453657 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 313/634] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:12 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1371 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:24:12.460549 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-b8f15424-73ae-4262-b2e0-7838f1603041 req-1579619b-3229-49db-ad30-9daa58dd6d87 service nova] Creating event network-vif-deleted:3958ac7c-4615-4de4-ac54-06e8a6e50ac7 for instance 99c8a6ff-979f-488e-8ea7-43158ba0570a on hv-cinder-84599 Aug 01 14:24:12.466154 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-b8f15424-73ae-4262-b2e0-7838f1603041 req-1579619b-3229-49db-ad30-9daa58dd6d87 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032616 Aug 01 14:24:12.466757 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 322/635] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:24:13.122619 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e46a7c55-72e8-4910-b460-730f5f4d44bc tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:13.123238 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e46a7c55-72e8-4910-b460-730f5f4d44bc tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:13.129878 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e46a7c55-72e8-4910-b460-730f5f4d44bc tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:13.130322 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e46a7c55-72e8-4910-b460-730f5f4d44bc tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:13.131096 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e46a7c55-72e8-4910-b460-730f5f4d44bc tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:13.131662 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e46a7c55-72e8-4910-b460-730f5f4d44bc tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:13.160834 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:13.165345 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e46a7c55-72e8-4910-b460-730f5f4d44bc tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:13.165794 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e46a7c55-72e8-4910-b460-730f5f4d44bc tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:13.166244 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-e46a7c55-72e8-4910-b460-730f5f4d44bc tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lazy-loading 'fault' on Instance uuid 99c8a6ff-979f-488e-8ea7-43158ba0570a {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:24:13.210799 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e46a7c55-72e8-4910-b460-730f5f4d44bc tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6938e54a8d49a6b00d3a6694d4e57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a69a51709439aad36192aece6133e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:13.219136 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e46a7c55-72e8-4910-b460-730f5f4d44bc tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 200 len: 1309 microversion: 2.1 time: 0.100534 Aug 01 14:24:13.219734 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 314/636] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:13 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:13.325000 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-59f67d05-e87e-434c-8b3c-13f9e1598d76 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:13.325795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-59f67d05-e87e-434c-8b3c-13f9e1598d76 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:13.333573 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-59f67d05-e87e-434c-8b3c-13f9e1598d76 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:13.334018 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-59f67d05-e87e-434c-8b3c-13f9e1598d76 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:13.334948 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-59f67d05-e87e-434c-8b3c-13f9e1598d76 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:13.335379 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-59f67d05-e87e-434c-8b3c-13f9e1598d76 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:13.370129 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-59f67d05-e87e-434c-8b3c-13f9e1598d76 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:13.370567 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-59f67d05-e87e-434c-8b3c-13f9e1598d76 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:13.371147 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-59f67d05-e87e-434c-8b3c-13f9e1598d76 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lazy-loading 'fault' on Instance uuid fdb50660-a83d-4b80-9be9-f1c264f3d711 {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:24:13.428547 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-59f67d05-e87e-434c-8b3c-13f9e1598d76 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:13.437457 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-59f67d05-e87e-434c-8b3c-13f9e1598d76 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1330 microversion: 2.1 time: 0.116968 Aug 01 14:24:13.438792 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 323/637] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:13 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1330 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:13.460891 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e596076f-b8c0-45bd-8994-8404e5fb30d1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:13.461610 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e596076f-b8c0-45bd-8994-8404e5fb30d1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:13.469581 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e596076f-b8c0-45bd-8994-8404e5fb30d1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:13.470058 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e596076f-b8c0-45bd-8994-8404e5fb30d1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:13.471091 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e596076f-b8c0-45bd-8994-8404e5fb30d1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:13.471602 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e596076f-b8c0-45bd-8994-8404e5fb30d1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:13.609133 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e596076f-b8c0-45bd-8994-8404e5fb30d1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:13.616892 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e596076f-b8c0-45bd-8994-8404e5fb30d1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1564 microversion: 2.1 time: 0.160372 Aug 01 14:24:13.617469 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 315/638] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:13 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:13.637419 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-71a3bf8e-4bb0-4021-bbc9-f998fba5ca23 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:13.637909 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-71a3bf8e-4bb0-4021-bbc9-f998fba5ca23 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:13.644308 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-71a3bf8e-4bb0-4021-bbc9-f998fba5ca23 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:13.644782 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-71a3bf8e-4bb0-4021-bbc9-f998fba5ca23 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:13.645527 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-71a3bf8e-4bb0-4021-bbc9-f998fba5ca23 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:13.645960 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-71a3bf8e-4bb0-4021-bbc9-f998fba5ca23 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:13.729162 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-71a3bf8e-4bb0-4021-bbc9-f998fba5ca23 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095848 Aug 01 14:24:13.729762 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 324/639] 10.222.0.17 () {58 vars in 1275 bytes} [Mon Aug 1 14:24:13 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:24:14.241396 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-99a8e575-e74b-4bb9-b691-18067f8993d4 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:14.242311 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-99a8e575-e74b-4bb9-b691-18067f8993d4 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] [instance: 99c8a6ff-979f-488e-8ea7-43158ba0570a] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:14.250449 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-99a8e575-e74b-4bb9-b691-18067f8993d4 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:14.250970 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-99a8e575-e74b-4bb9-b691-18067f8993d4 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:14.252125 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-99a8e575-e74b-4bb9-b691-18067f8993d4 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:14.252836 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-99a8e575-e74b-4bb9-b691-18067f8993d4 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:14.269943 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-99a8e575-e74b-4bb9-b691-18067f8993d4 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] HTTP exception thrown: Instance 99c8a6ff-979f-488e-8ea7-43158ba0570a could not be found. Aug 01 14:24:14.271772 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-99a8e575-e74b-4bb9-b691-18067f8993d4 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Request method failure captured: Aug 01 14:24:14.271772 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a HTTP/1.1 Aug 01 14:24:14.271772 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:24:14.271772 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:24:14.271772 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:24:14.271772 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 0 Aug 01 14:24:14.271772 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:24:14.271772 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:24:14.271772 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:24:14.271772 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:24:14.271772 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-FO2wlExb1kkJhcvTrx3y6fIdhT-B2RqNZqdwvqiz7S_dEZPRjv0xcocWDrxk-SJfUvTjq_8vqFPUCSJG3PKq7RN_025_IchPGaNnwXbT1MOFTeTSaZysDklnUw69ljoqCA60bXEhkzfIR0PoVZqv5J1_HmPeHyKc_DluGL96cI1Ew Aug 01 14:24:14.271772 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:24:14.271772 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:24:14.271772 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:24:14.271772 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:24:14.271772 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:24:14.271772 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:24:14.271772 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: 486a69a51709439aad36192aece6133e Aug 01 14:24:14.271772 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1215587601 Aug 01 14:24:14.271772 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:24:14.271772 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:24:14.273290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/486a69a51709439aad36192aece6133e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/486a69a51709439aad36192aece6133e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/486a69a51709439aad36192aece6133e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_486a69a51709439aad36192aece6133e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:24:14.273290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-VolumesSnapshotTestJSON-1215587601 Aug 01 14:24:14.273290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 486a69a51709439aad36192aece6133e Aug 01 14:24:14.273290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1215587601 Aug 01 14:24:14.273290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-VolumesSnapshotTestJSON-1215587601-project Aug 01 14:24:14.273290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:24:14.273290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:24:14.273290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: 0f6938e54a8d49a6b00d3a6694d4e57f Aug 01 14:24:14.273290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-VolumesSnapshotTestJSON-1215587601-project Aug 01 14:24:14.273290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: > Aug 01 14:24:14.273290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Instance 99c8a6ff-979f-488e-8ea7-43158ba0570a could not be found. Aug 01 14:24:14.273290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'id': '99c8a6ff-979f-488e-8ea7-43158ba0570a'} Aug 01 14:24:14.274097 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:24:14.274097 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:24:14.274097 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:24:14.274097 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:24:14.274097 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:24:14.274097 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:24:14.274097 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:24:14.274097 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:24:14.274097 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:24:14.274097 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:24:14.274097 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99c8a6ff-979f-488e-8ea7-43158ba0570a could not be found. Aug 01 14:24:14.274097 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:24:14.274097 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:24:14.274097 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:24:14.274097 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:24:14.274097 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:24:14.274097 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:24:14.274097 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:24:14.274097 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:24:14.274097 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:24:14.275473 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:24:14.275473 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:24:14.275473 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:24:14.275473 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:24:14.275473 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:24:14.275473 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:24:14.275473 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:24:14.275473 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99c8a6ff-979f-488e-8ea7-43158ba0570a could not be found. Aug 01 14:24:14.275473 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:24:14.275473 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:24:14.275473 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:24:14.275473 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:24:14.275473 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:24:14.275473 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:24:14.275473 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:24:14.275473 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:24:14.275473 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99c8a6ff-979f-488e-8ea7-43158ba0570a could not be found. Aug 01 14:24:14.275473 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:24:14.276621 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-99a8e575-e74b-4bb9-b691-18067f8993d4 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] Returning 404 to user: Instance 99c8a6ff-979f-488e-8ea7-43158ba0570a could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:24:14.276621 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-99a8e575-e74b-4bb9-b691-18067f8993d4 tempest-VolumesSnapshotTestJSON-1215587601 tempest-VolumesSnapshotTestJSON-1215587601-project] 10.222.0.17 "GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a" status: 404 len: 111 microversion: 2.1 time: 0.036208 Aug 01 14:24:14.276621 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 316/640] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:14 2022] GET /compute/v2.1/servers/99c8a6ff-979f-488e-8ea7-43158ba0570a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:24:14.459800 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a0dda7b0-1dae-43cd-af8b-633f5433ca9a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:14.461099 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a0dda7b0-1dae-43cd-af8b-633f5433ca9a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:14.468082 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a0dda7b0-1dae-43cd-af8b-633f5433ca9a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:14.468909 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a0dda7b0-1dae-43cd-af8b-633f5433ca9a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:14.470436 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a0dda7b0-1dae-43cd-af8b-633f5433ca9a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:14.471093 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a0dda7b0-1dae-43cd-af8b-633f5433ca9a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:14.492411 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-bb31f2b9-9e35-4303-98bf-0966d8b267e9 req-f7ce0095-1f64-4f9b-9aa8-d3708fd51937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdb50660-a83d-4b80-9be9-f1c264f3d711", "name": "network-vif-deleted", "tag": "549718cd-576c-4fb6-9df8-7e4cef065b1b"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:24:14.512965 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a0dda7b0-1dae-43cd-af8b-633f5433ca9a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:14.517032 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-bb31f2b9-9e35-4303-98bf-0966d8b267e9 req-f7ce0095-1f64-4f9b-9aa8-d3708fd51937 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:14.517428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a0dda7b0-1dae-43cd-af8b-633f5433ca9a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:14.517685 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-bb31f2b9-9e35-4303-98bf-0966d8b267e9 req-f7ce0095-1f64-4f9b-9aa8-d3708fd51937 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:14.518139 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-a0dda7b0-1dae-43cd-af8b-633f5433ca9a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lazy-loading 'fault' on Instance uuid fdb50660-a83d-4b80-9be9-f1c264f3d711 {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:24:14.546481 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-bb31f2b9-9e35-4303-98bf-0966d8b267e9 req-f7ce0095-1f64-4f9b-9aa8-d3708fd51937 service nova] Creating event network-vif-deleted:549718cd-576c-4fb6-9df8-7e4cef065b1b for instance fdb50660-a83d-4b80-9be9-f1c264f3d711 on hv-cinder-84599 Aug 01 14:24:14.558714 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-bb31f2b9-9e35-4303-98bf-0966d8b267e9 req-f7ce0095-1f64-4f9b-9aa8-d3708fd51937 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069918 Aug 01 14:24:14.559740 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 317/641] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:24:14.638983 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a0dda7b0-1dae-43cd-af8b-633f5433ca9a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:14.649657 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a0dda7b0-1dae-43cd-af8b-633f5433ca9a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 200 len: 1330 microversion: 2.1 time: 0.194589 Aug 01 14:24:14.650250 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 325/642] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:14 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 1330 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:15.671757 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6c429529-86bd-4801-abfe-666d3f6e1f9e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:15.672446 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-6c429529-86bd-4801-abfe-666d3f6e1f9e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:15.678858 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6c429529-86bd-4801-abfe-666d3f6e1f9e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:15.679372 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6c429529-86bd-4801-abfe-666d3f6e1f9e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:15.680243 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6c429529-86bd-4801-abfe-666d3f6e1f9e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:15.680753 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6c429529-86bd-4801-abfe-666d3f6e1f9e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:15.695177 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-6c429529-86bd-4801-abfe-666d3f6e1f9e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] HTTP exception thrown: Instance fdb50660-a83d-4b80-9be9-f1c264f3d711 could not be found. Aug 01 14:24:15.696907 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6c429529-86bd-4801-abfe-666d3f6e1f9e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Request method failure captured: Aug 01 14:24:15.696907 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 HTTP/1.1 Aug 01 14:24:15.696907 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:24:15.696907 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:24:15.696907 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:24:15.696907 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 0 Aug 01 14:24:15.696907 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:24:15.696907 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:24:15.696907 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:24:15.696907 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:24:15.696907 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-EkulQUZ9RnUqab4WEJwGiX-pJM7HxTgHalzWuk3LLo8fvk1GbjHf7oAdc4K40oSiRvHm3paXWQHzpNKMP3IF1Z4LwboIgWgWHXBlkSgdewDx_VoBUgWaMnbInPDU7YB5AlXhd0VLng73Y5VTtdj1967GURnhVKliVHkMShTgChU3Y Aug 01 14:24:15.696907 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:24:15.696907 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:24:15.696907 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:24:15.696907 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:24:15.696907 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:24:15.696907 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:24:15.696907 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: 3092982f3c6f4851a5a6e84bf7872d11 Aug 01 14:24:15.696907 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:24:15.696907 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:24:15.696907 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:24:15.698450 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3092982f3c6f4851a5a6e84bf7872d11", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:24:15.698450 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:24:15.698450 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 3092982f3c6f4851a5a6e84bf7872d11 Aug 01 14:24:15.698450 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:24:15.698450 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-AttachVolumeNegativeTest-134821563-project Aug 01 14:24:15.698450 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:24:15.698450 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:24:15.698450 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: 9eda4e19122444cf9cb2b6941adff9d5 Aug 01 14:24:15.698450 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-AttachVolumeNegativeTest-134821563-project Aug 01 14:24:15.698450 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: > Aug 01 14:24:15.698450 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Instance fdb50660-a83d-4b80-9be9-f1c264f3d711 could not be found. Aug 01 14:24:15.698450 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'id': 'fdb50660-a83d-4b80-9be9-f1c264f3d711'} Aug 01 14:24:15.699290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:24:15.699290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:24:15.699290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:24:15.699290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:24:15.699290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:24:15.699290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:24:15.699290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:24:15.699290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:24:15.699290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:24:15.699290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:24:15.699290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdb50660-a83d-4b80-9be9-f1c264f3d711 could not be found. Aug 01 14:24:15.699290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:24:15.699290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:24:15.699290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:24:15.699290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:24:15.699290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:24:15.699290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:24:15.699290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:24:15.699290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:24:15.699290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:24:15.700799 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:24:15.700799 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:24:15.700799 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:24:15.700799 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:24:15.700799 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:24:15.700799 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:24:15.700799 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:24:15.700799 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdb50660-a83d-4b80-9be9-f1c264f3d711 could not be found. Aug 01 14:24:15.700799 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:24:15.700799 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:24:15.700799 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:24:15.700799 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:24:15.700799 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:24:15.700799 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:24:15.700799 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:24:15.700799 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:24:15.700799 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdb50660-a83d-4b80-9be9-f1c264f3d711 could not be found. Aug 01 14:24:15.700799 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:24:15.702015 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6c429529-86bd-4801-abfe-666d3f6e1f9e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Returning 404 to user: Instance fdb50660-a83d-4b80-9be9-f1c264f3d711 could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:24:15.702015 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6c429529-86bd-4801-abfe-666d3f6e1f9e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 404 len: 111 microversion: 2.1 time: 0.032140 Aug 01 14:24:15.702625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 318/643] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:15 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:24:15.708285 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-30180501-93d8-4f29-a129-d4fa839e7f12 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '.version_select at 0x7f6184bda040>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:15.730524 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-30180501-93d8-4f29-a129-d4fa839e7f12 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-671634509" status: 202 len: 0 microversion: 2.1 time: 0.026485 Aug 01 14:24:15.731608 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 326/644] 10.222.0.17 () {58 vars in 1218 bytes} [Mon Aug 1 14:24:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-671634509 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:24:16.431007 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f45441a4-57b5-40b2-a987-25c6387dc01e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Action: 'create', calling method: .version_select at 0x7f61854e0f70>, body: {"keypair": {"name": "tempest-keypair-48999490", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGezFW7ncd2r20F3Z9zq+yNyfroLcGmS68uVktlZv9a+WErKpNJSELTf4V9VUJjk6Uq9Y6l0Pn2PCOlc6a4sXTAhva8jBMpZFf4MJ35tLy1sPIpH/diwwniOHsI3us6EfQ=="}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:24:16.447830 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-f45441a4-57b5-40b2-a987-25c6387dc01e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Getting quotas for project 3092982f3c6f4851a5a6e84bf7872d11. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:24:16.451927 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-f45441a4-57b5-40b2-a987-25c6387dc01e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Getting quotas for user 9eda4e19122444cf9cb2b6941adff9d5 and project 3092982f3c6f4851a5a6e84bf7872d11. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:24:16.475159 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f45441a4-57b5-40b2-a987-25c6387dc01e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.047921 Aug 01 14:24:16.475796 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 319/645] 10.222.0.17 () {60 vars in 1159 bytes} [Mon Aug 1 14:24:16 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:24:16.618141 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-1a52bee5-b63c-4726-b599-768cc4d31e4e req-a16ae226-ae12-4678-96cf-c95e2bb1394e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5664fd60-279c-4671-9a77-a5bc99baf7be", "tag": "2898c3ea-4ab0-4c5f-9813-8db5fcaa5a1d"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:24:16.630538 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-1a52bee5-b63c-4726-b599-768cc4d31e4e req-a16ae226-ae12-4678-96cf-c95e2bb1394e service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:16.631011 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-1a52bee5-b63c-4726-b599-768cc4d31e4e req-a16ae226-ae12-4678-96cf-c95e2bb1394e service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:16.659112 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-1a52bee5-b63c-4726-b599-768cc4d31e4e req-a16ae226-ae12-4678-96cf-c95e2bb1394e service nova] Creating event network-changed:2898c3ea-4ab0-4c5f-9813-8db5fcaa5a1d for instance 5664fd60-279c-4671-9a77-a5bc99baf7be on hv-cinder-84599 Aug 01 14:24:16.664697 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-1a52bee5-b63c-4726-b599-768cc4d31e4e req-a16ae226-ae12-4678-96cf-c95e2bb1394e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049853 Aug 01 14:24:16.665211 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 327/646] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:24:17.730034 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8a74f344-2415-4949-b6f8-36809bc194c9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-548770076", "imageRef": "9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de859ae5-345c-4f53-adf9-d10ff3cac7a2"}], "security_groups": [{"name": "tempest-securitygroup--1600661178"}], "key_name": "tempest-keypair-48999490", "user_data": "}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:24:17.831564 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.network.neutron [None req-8a74f344-2415-4949-b6f8-36809bc194c9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] validate_networks() for [('de859ae5-345c-4f53-adf9-d10ff3cac7a2', None, None, None, None, None)] {{(pid=118133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:24:18.205220 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-8a74f344-2415-4949-b6f8-36809bc194c9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Flavor limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:24:18.205644 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-8a74f344-2415-4949-b6f8-36809bc194c9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Image limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:24:18.206114 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-8a74f344-2415-4949-b6f8-36809bc194c9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Flavor pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:24:18.206521 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-8a74f344-2415-4949-b6f8-36809bc194c9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Image pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:24:18.206931 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-8a74f344-2415-4949-b6f8-36809bc194c9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:24:18.216076 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8a74f344-2415-4949-b6f8-36809bc194c9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:18.216516 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8a74f344-2415-4949-b6f8-36809bc194c9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:18.217334 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8a74f344-2415-4949-b6f8-36809bc194c9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:18.217761 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8a74f344-2415-4949-b6f8-36809bc194c9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:18.233971 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-8a74f344-2415-4949-b6f8-36809bc194c9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Getting quotas for project 3092982f3c6f4851a5a6e84bf7872d11. Resources: {'instances', 'cores', 'ram'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:24:18.237866 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-8a74f344-2415-4949-b6f8-36809bc194c9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Getting quotas for user 9eda4e19122444cf9cb2b6941adff9d5 and project 3092982f3c6f4851a5a6e84bf7872d11. Resources: {'instances', 'cores', 'ram'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:24:18.249102 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8a74f344-2415-4949-b6f8-36809bc194c9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Going to run 1 instances... {{(pid=118133) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:24:18.257488 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8a74f344-2415-4949-b6f8-36809bc194c9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:24:18.304884 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8a74f344-2415-4949-b6f8-36809bc194c9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.579639 Aug 01 14:24:18.305437 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 320/647] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Aug 1 14:24:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:24:18.318051 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6e8109e1-bb2a-4120-b73f-119871b94a48 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:18.318814 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-6e8109e1-bb2a-4120-b73f-119871b94a48 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:18.372766 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6e8109e1-bb2a-4120-b73f-119871b94a48 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:18.380105 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6e8109e1-bb2a-4120-b73f-119871b94a48 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39" status: 200 len: 1239 microversion: 2.1 time: 0.066930 Aug 01 14:24:18.380692 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 328/648] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:18 2022] GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39 => generated 1239 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:19.401808 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e15d6529-e255-4ac8-989f-2a8955014ddd tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:19.402419 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e15d6529-e255-4ac8-989f-2a8955014ddd tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:19.410355 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e15d6529-e255-4ac8-989f-2a8955014ddd tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:19.410799 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e15d6529-e255-4ac8-989f-2a8955014ddd tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:19.411593 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e15d6529-e255-4ac8-989f-2a8955014ddd tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:19.412022 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e15d6529-e255-4ac8-989f-2a8955014ddd tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:19.478300 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e15d6529-e255-4ac8-989f-2a8955014ddd tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:19.486686 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e15d6529-e255-4ac8-989f-2a8955014ddd tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39" status: 200 len: 1291 microversion: 2.1 time: 0.089862 Aug 01 14:24:19.487256 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 321/649] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:19 2022] GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39 => generated 1291 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:24:20.509164 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b0de0e7f-c6af-4bcd-acc5-29ce39d5b745 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:20.509773 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b0de0e7f-c6af-4bcd-acc5-29ce39d5b745 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:20.518278 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b0de0e7f-c6af-4bcd-acc5-29ce39d5b745 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:20.518827 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b0de0e7f-c6af-4bcd-acc5-29ce39d5b745 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:20.519728 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b0de0e7f-c6af-4bcd-acc5-29ce39d5b745 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:20.520240 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b0de0e7f-c6af-4bcd-acc5-29ce39d5b745 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:20.797366 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b0de0e7f-c6af-4bcd-acc5-29ce39d5b745 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:20.805382 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b0de0e7f-c6af-4bcd-acc5-29ce39d5b745 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39" status: 200 len: 1365 microversion: 2.1 time: 0.300077 Aug 01 14:24:20.805965 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 329/650] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:20 2022] GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39 => generated 1365 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:21.067469 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-3dd5b298-14ca-4cbd-8618-92bfd82fd5bf req-e168b7af-f9b1-43c5-bf90-0ba09996c262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ca84836-fe43-46c9-9829-ed762608ad39", "tag": "c9494ca7-e397-46ff-826b-71a8075c3785"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:24:21.079832 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-3dd5b298-14ca-4cbd-8618-92bfd82fd5bf req-e168b7af-f9b1-43c5-bf90-0ba09996c262 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:21.080818 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-3dd5b298-14ca-4cbd-8618-92bfd82fd5bf req-e168b7af-f9b1-43c5-bf90-0ba09996c262 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:21.092822 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-3dd5b298-14ca-4cbd-8618-92bfd82fd5bf req-e168b7af-f9b1-43c5-bf90-0ba09996c262 service nova] Creating event network-changed:c9494ca7-e397-46ff-826b-71a8075c3785 for instance 4ca84836-fe43-46c9-9829-ed762608ad39 on hv-cinder-84599 Aug 01 14:24:21.098521 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-3dd5b298-14ca-4cbd-8618-92bfd82fd5bf req-e168b7af-f9b1-43c5-bf90-0ba09996c262 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034232 Aug 01 14:24:21.099448 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 322/651] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:24:21.827617 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d7fd6ea9-21b5-4e89-826e-2b8bc2e46647 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:21.828229 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d7fd6ea9-21b5-4e89-826e-2b8bc2e46647 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:21.835709 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d7fd6ea9-21b5-4e89-826e-2b8bc2e46647 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:21.836158 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d7fd6ea9-21b5-4e89-826e-2b8bc2e46647 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:21.836998 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d7fd6ea9-21b5-4e89-826e-2b8bc2e46647 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:21.850605 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d7fd6ea9-21b5-4e89-826e-2b8bc2e46647 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:21.979350 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d7fd6ea9-21b5-4e89-826e-2b8bc2e46647 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:21.987369 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d7fd6ea9-21b5-4e89-826e-2b8bc2e46647 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39" status: 200 len: 1365 microversion: 2.1 time: 0.164187 Aug 01 14:24:21.987958 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 330/652] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:21 2022] GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:23.008701 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-29797673-0406-4c81-9156-98a6a4491f2e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:23.009557 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-29797673-0406-4c81-9156-98a6a4491f2e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:23.017119 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-29797673-0406-4c81-9156-98a6a4491f2e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:23.017586 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-29797673-0406-4c81-9156-98a6a4491f2e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:23.018349 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-29797673-0406-4c81-9156-98a6a4491f2e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:23.018786 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-29797673-0406-4c81-9156-98a6a4491f2e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:23.174231 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-29797673-0406-4c81-9156-98a6a4491f2e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:23.183120 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-29797673-0406-4c81-9156-98a6a4491f2e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39" status: 200 len: 1365 microversion: 2.1 time: 0.178570 Aug 01 14:24:23.183827 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 323/653] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:23 2022] GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:24.208873 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0b667443-59d9-46b9-b5d0-1b05d3e5f2ff tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:24.209488 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0b667443-59d9-46b9-b5d0-1b05d3e5f2ff tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:24.216239 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0b667443-59d9-46b9-b5d0-1b05d3e5f2ff tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:24.216686 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0b667443-59d9-46b9-b5d0-1b05d3e5f2ff tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:24.217455 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0b667443-59d9-46b9-b5d0-1b05d3e5f2ff tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:24.217890 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0b667443-59d9-46b9-b5d0-1b05d3e5f2ff tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:24.349785 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0b667443-59d9-46b9-b5d0-1b05d3e5f2ff tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:24.357219 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0b667443-59d9-46b9-b5d0-1b05d3e5f2ff tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39" status: 200 len: 1365 microversion: 2.1 time: 0.153455 Aug 01 14:24:24.357789 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 331/654] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:24 2022] GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:25.378992 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f73e946f-515f-478b-a1a4-29d4711ddf22 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:25.379727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f73e946f-515f-478b-a1a4-29d4711ddf22 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:25.386318 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f73e946f-515f-478b-a1a4-29d4711ddf22 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:25.386772 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f73e946f-515f-478b-a1a4-29d4711ddf22 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:25.387709 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f73e946f-515f-478b-a1a4-29d4711ddf22 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:25.388136 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f73e946f-515f-478b-a1a4-29d4711ddf22 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:25.525534 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f73e946f-515f-478b-a1a4-29d4711ddf22 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:25.533414 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f73e946f-515f-478b-a1a4-29d4711ddf22 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39" status: 200 len: 1365 microversion: 2.1 time: 0.158996 Aug 01 14:24:25.533970 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 324/655] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:25 2022] GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:26.554948 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-44d11b1b-5979-4478-b05f-280c93a5df64 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:26.555716 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-44d11b1b-5979-4478-b05f-280c93a5df64 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:26.562234 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-44d11b1b-5979-4478-b05f-280c93a5df64 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:26.562678 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-44d11b1b-5979-4478-b05f-280c93a5df64 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:26.563478 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-44d11b1b-5979-4478-b05f-280c93a5df64 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:26.564455 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-44d11b1b-5979-4478-b05f-280c93a5df64 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:26.695743 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-44d11b1b-5979-4478-b05f-280c93a5df64 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:26.703264 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-44d11b1b-5979-4478-b05f-280c93a5df64 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39" status: 200 len: 1365 microversion: 2.1 time: 0.152243 Aug 01 14:24:26.704291 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 332/656] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:26 2022] GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:27.723810 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f728128a-1316-4ce5-ab31-78ef0d29ca7f tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:27.724408 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f728128a-1316-4ce5-ab31-78ef0d29ca7f tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:27.730524 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f728128a-1316-4ce5-ab31-78ef0d29ca7f tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:27.730967 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f728128a-1316-4ce5-ab31-78ef0d29ca7f tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:27.731742 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f728128a-1316-4ce5-ab31-78ef0d29ca7f tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:27.732172 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f728128a-1316-4ce5-ab31-78ef0d29ca7f tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:27.736161 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:27.861396 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f728128a-1316-4ce5-ab31-78ef0d29ca7f tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:27.869406 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f728128a-1316-4ce5-ab31-78ef0d29ca7f tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39" status: 200 len: 1365 microversion: 2.1 time: 0.149654 Aug 01 14:24:27.869979 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 325/657] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:27 2022] GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:28.016755 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-80d4866d-391d-4023-92f7-298077ad08e7 req-87298783-ab38-4b13-a03c-e6d9ec57d86d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ca84836-fe43-46c9-9829-ed762608ad39", "name": "network-vif-plugged", "status": "completed", "tag": "c9494ca7-e397-46ff-826b-71a8075c3785"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:24:28.026429 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-80d4866d-391d-4023-92f7-298077ad08e7 req-87298783-ab38-4b13-a03c-e6d9ec57d86d service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:28.026870 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-80d4866d-391d-4023-92f7-298077ad08e7 req-87298783-ab38-4b13-a03c-e6d9ec57d86d service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:28.038894 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-80d4866d-391d-4023-92f7-298077ad08e7 req-87298783-ab38-4b13-a03c-e6d9ec57d86d service nova] Creating event network-vif-plugged:c9494ca7-e397-46ff-826b-71a8075c3785 for instance 4ca84836-fe43-46c9-9829-ed762608ad39 on hv-cinder-84599 Aug 01 14:24:28.043682 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-80d4866d-391d-4023-92f7-298077ad08e7 req-87298783-ab38-4b13-a03c-e6d9ec57d86d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030871 Aug 01 14:24:28.044330 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 333/658] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:24:28.890583 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0c6cf95b-bc2c-48b3-9660-8596969966c3 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:28.891117 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0c6cf95b-bc2c-48b3-9660-8596969966c3 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:28.893010 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:28.893664 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=10 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:28.900061 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0c6cf95b-bc2c-48b3-9660-8596969966c3 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:28.900513 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0c6cf95b-bc2c-48b3-9660-8596969966c3 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:28.901281 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0c6cf95b-bc2c-48b3-9660-8596969966c3 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:28.901726 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0c6cf95b-bc2c-48b3-9660-8596969966c3 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:29.037019 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0c6cf95b-bc2c-48b3-9660-8596969966c3 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:29.044459 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0c6cf95b-bc2c-48b3-9660-8596969966c3 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39" status: 200 len: 1365 microversion: 2.1 time: 0.157898 Aug 01 14:24:29.045065 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 326/659] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:28 2022] GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:30.062660 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=2 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:30.067730 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c91aaec1-0e57-4a23-9753-934cd9eea5f9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:30.068469 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c91aaec1-0e57-4a23-9753-934cd9eea5f9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:30.075159 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c91aaec1-0e57-4a23-9753-934cd9eea5f9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:30.075697 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c91aaec1-0e57-4a23-9753-934cd9eea5f9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:30.076464 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c91aaec1-0e57-4a23-9753-934cd9eea5f9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:30.076902 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c91aaec1-0e57-4a23-9753-934cd9eea5f9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:30.208816 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c91aaec1-0e57-4a23-9753-934cd9eea5f9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:30.216404 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c91aaec1-0e57-4a23-9753-934cd9eea5f9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39" status: 200 len: 1365 microversion: 2.1 time: 0.154657 Aug 01 14:24:30.217069 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 334/660] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:30 2022] GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:31.239060 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8677b53c-be9e-4fe9-8d16-6a581b719793 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:31.239680 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8677b53c-be9e-4fe9-8d16-6a581b719793 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:31.246320 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8677b53c-be9e-4fe9-8d16-6a581b719793 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:31.246767 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8677b53c-be9e-4fe9-8d16-6a581b719793 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:31.247564 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8677b53c-be9e-4fe9-8d16-6a581b719793 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:31.248011 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8677b53c-be9e-4fe9-8d16-6a581b719793 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:31.381400 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8677b53c-be9e-4fe9-8d16-6a581b719793 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:31.389211 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8677b53c-be9e-4fe9-8d16-6a581b719793 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39" status: 200 len: 1554 microversion: 2.1 time: 0.154710 Aug 01 14:24:31.389779 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 327/661] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:31 2022] GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:31.409821 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-69174554-efa7-4331-b51d-3f9a71b632b8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:31.410369 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-69174554-efa7-4331-b51d-3f9a71b632b8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:31.416872 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-69174554-efa7-4331-b51d-3f9a71b632b8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:31.417351 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-69174554-efa7-4331-b51d-3f9a71b632b8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:31.418072 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-69174554-efa7-4331-b51d-3f9a71b632b8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:31.418497 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-69174554-efa7-4331-b51d-3f9a71b632b8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:31.505213 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-69174554-efa7-4331-b51d-3f9a71b632b8 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099225 Aug 01 14:24:31.505835 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 335/662] 10.222.0.17 () {58 vars in 1275 bytes} [Mon Aug 1 14:24:31 2022] GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:24:32.435983 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-540e3a81-38b9-4cb3-82fa-4dd3abf19b1d req-b4f5ce2c-3b31-4f4b-ba81-75a06325fe50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ca84836-fe43-46c9-9829-ed762608ad39", "tag": "c9494ca7-e397-46ff-826b-71a8075c3785"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:24:32.446523 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-540e3a81-38b9-4cb3-82fa-4dd3abf19b1d req-b4f5ce2c-3b31-4f4b-ba81-75a06325fe50 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:32.446961 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-540e3a81-38b9-4cb3-82fa-4dd3abf19b1d req-b4f5ce2c-3b31-4f4b-ba81-75a06325fe50 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:32.460181 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-540e3a81-38b9-4cb3-82fa-4dd3abf19b1d req-b4f5ce2c-3b31-4f4b-ba81-75a06325fe50 service nova] Creating event network-changed:c9494ca7-e397-46ff-826b-71a8075c3785 for instance 4ca84836-fe43-46c9-9829-ed762608ad39 on hv-cinder-84599 Aug 01 14:24:32.465232 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-540e3a81-38b9-4cb3-82fa-4dd3abf19b1d req-b4f5ce2c-3b31-4f4b-ba81-75a06325fe50 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032838 Aug 01 14:24:32.465896 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 328/663] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:24:43.598553 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:43.599297 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=88 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:43.603475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ace436f0-ed46-4a32-b4e6-cc842be88c9f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:43.603982 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ace436f0-ed46-4a32-b4e6-cc842be88c9f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:43.611878 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ace436f0-ed46-4a32-b4e6-cc842be88c9f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:43.612331 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ace436f0-ed46-4a32-b4e6-cc842be88c9f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:43.613096 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ace436f0-ed46-4a32-b4e6-cc842be88c9f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:43.613587 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ace436f0-ed46-4a32-b4e6-cc842be88c9f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:43.642338 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ace436f0-ed46-4a32-b4e6-cc842be88c9f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680/os-volume_attachments/2c7dd47a-1e65-4efd-abab-263d8d2f9def" status: 200 len: 194 microversion: 2.20 time: 0.045195 Aug 01 14:24:43.642957 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 336/664] 10.222.0.17 () {60 vars in 1454 bytes} [Mon Aug 1 14:24:43 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680/os-volume_attachments/2c7dd47a-1e65-4efd-abab-263d8d2f9def => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:24:43.706952 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:43.707727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=18 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:43.711918 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-cd091252-48a3-4987-8fc4-30779930e685 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:43.712531 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-cd091252-48a3-4987-8fc4-30779930e685 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:43.720640 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cd091252-48a3-4987-8fc4-30779930e685 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:43.721089 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cd091252-48a3-4987-8fc4-30779930e685 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:43.721851 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cd091252-48a3-4987-8fc4-30779930e685 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:43.722288 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cd091252-48a3-4987-8fc4-30779930e685 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:43.803094 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-cd091252-48a3-4987-8fc4-30779930e685 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lazy-loading 'services' on Instance uuid 76deb7da-88aa-4c26-b55d-fd6432d1e680 {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:24:43.874568 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-cd091252-48a3-4987-8fc4-30779930e685 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "DELETE /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680/os-volume_attachments/2c7dd47a-1e65-4efd-abab-263d8d2f9def" status: 202 len: 0 microversion: 2.20 time: 0.169121 Aug 01 14:24:43.875189 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 329/665] 10.222.0.17 () {60 vars in 1457 bytes} [Mon Aug 1 14:24:43 2022] DELETE /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680/os-volume_attachments/2c7dd47a-1e65-4efd-abab-263d8d2f9def => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:24:43.883597 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-24c14f1c-255f-4ca3-a8fb-2abdf2b6208f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:43.885763 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-24c14f1c-255f-4ca3-a8fb-2abdf2b6208f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:43.892347 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-24c14f1c-255f-4ca3-a8fb-2abdf2b6208f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:43.892790 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-24c14f1c-255f-4ca3-a8fb-2abdf2b6208f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:43.893587 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-24c14f1c-255f-4ca3-a8fb-2abdf2b6208f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:43.893996 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-24c14f1c-255f-4ca3-a8fb-2abdf2b6208f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:43.924102 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-24c14f1c-255f-4ca3-a8fb-2abdf2b6208f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044479 Aug 01 14:24:43.924670 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 337/666] 10.222.0.17 () {60 vars in 1343 bytes} [Mon Aug 1 14:24:43 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:24:44.937284 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d7c901c8-617e-49cb-9eda-d5b2bf108fd9 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:44.940667 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d7c901c8-617e-49cb-9eda-d5b2bf108fd9 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:44.947105 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d7c901c8-617e-49cb-9eda-d5b2bf108fd9 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:44.947573 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d7c901c8-617e-49cb-9eda-d5b2bf108fd9 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:44.948338 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d7c901c8-617e-49cb-9eda-d5b2bf108fd9 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:44.948767 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d7c901c8-617e-49cb-9eda-d5b2bf108fd9 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:44.981263 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d7c901c8-617e-49cb-9eda-d5b2bf108fd9 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048711 Aug 01 14:24:44.981824 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 330/667] 10.222.0.17 () {60 vars in 1343 bytes} [Mon Aug 1 14:24:44 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:45.044959 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-205a1b73-a8d7-43bb-9824-21f458ca90f3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:45.045499 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-205a1b73-a8d7-43bb-9824-21f458ca90f3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:45.052544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-205a1b73-a8d7-43bb-9824-21f458ca90f3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:45.052989 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-205a1b73-a8d7-43bb-9824-21f458ca90f3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:45.053750 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-205a1b73-a8d7-43bb-9824-21f458ca90f3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:45.054187 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-205a1b73-a8d7-43bb-9824-21f458ca90f3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:45.079418 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-205a1b73-a8d7-43bb-9824-21f458ca90f3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Going to try to terminate instance {{(pid=118132) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:24:45.155839 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-205a1b73-a8d7-43bb-9824-21f458ca90f3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "DELETE /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 204 len: 0 microversion: 2.20 time: 0.114329 Aug 01 14:24:45.156948 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 338/668] 10.222.0.17 () {60 vars in 1280 bytes} [Mon Aug 1 14:24:45 2022] DELETE /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 14:24:45.165094 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9a498eeb-682e-4e50-b2b5-88d3294cdc47 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:45.165690 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9a498eeb-682e-4e50-b2b5-88d3294cdc47 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:45.171731 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9a498eeb-682e-4e50-b2b5-88d3294cdc47 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:45.172823 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9a498eeb-682e-4e50-b2b5-88d3294cdc47 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:45.173581 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9a498eeb-682e-4e50-b2b5-88d3294cdc47 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:45.174010 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9a498eeb-682e-4e50-b2b5-88d3294cdc47 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:45.305815 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9a498eeb-682e-4e50-b2b5-88d3294cdc47 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:45.313713 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9a498eeb-682e-4e50-b2b5-88d3294cdc47 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:45.315208 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9a498eeb-682e-4e50-b2b5-88d3294cdc47 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:45.316384 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9a498eeb-682e-4e50-b2b5-88d3294cdc47 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1724 microversion: 2.20 time: 0.155153 Aug 01 14:24:45.316943 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 331/669] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:45 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:46.341674 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a0f1a40f-61b5-462c-ac7e-8e1c9eab1d7b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:46.342384 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a0f1a40f-61b5-462c-ac7e-8e1c9eab1d7b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:46.349879 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a0f1a40f-61b5-462c-ac7e-8e1c9eab1d7b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:46.350325 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a0f1a40f-61b5-462c-ac7e-8e1c9eab1d7b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:46.351079 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a0f1a40f-61b5-462c-ac7e-8e1c9eab1d7b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:46.351535 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a0f1a40f-61b5-462c-ac7e-8e1c9eab1d7b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:46.483781 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a0f1a40f-61b5-462c-ac7e-8e1c9eab1d7b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:46.491784 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a0f1a40f-61b5-462c-ac7e-8e1c9eab1d7b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:46.493292 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a0f1a40f-61b5-462c-ac7e-8e1c9eab1d7b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:46.494456 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a0f1a40f-61b5-462c-ac7e-8e1c9eab1d7b tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1724 microversion: 2.20 time: 0.157314 Aug 01 14:24:46.495012 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 339/670] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:46 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:47.520635 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-50005563-9aea-4418-b9d2-c7e716880635 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:47.521761 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-50005563-9aea-4418-b9d2-c7e716880635 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:47.529156 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-50005563-9aea-4418-b9d2-c7e716880635 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:47.529603 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-50005563-9aea-4418-b9d2-c7e716880635 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:47.530386 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-50005563-9aea-4418-b9d2-c7e716880635 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:47.530816 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-50005563-9aea-4418-b9d2-c7e716880635 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:47.705826 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-50005563-9aea-4418-b9d2-c7e716880635 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:47.715638 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-50005563-9aea-4418-b9d2-c7e716880635 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:47.717665 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-50005563-9aea-4418-b9d2-c7e716880635 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:47.718934 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-50005563-9aea-4418-b9d2-c7e716880635 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1724 microversion: 2.20 time: 0.204486 Aug 01 14:24:47.720496 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 332/671] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:47 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:48.150470 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-a11c8504-d5df-4a88-a8ac-dc62df90be4d req-7fc188e2-1056-4ddb-aa5e-03b6512bd1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76deb7da-88aa-4c26-b55d-fd6432d1e680", "name": "network-vif-deleted", "tag": "e905a309-fe29-4762-880d-f6eb375da04f"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:24:48.161331 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-a11c8504-d5df-4a88-a8ac-dc62df90be4d req-7fc188e2-1056-4ddb-aa5e-03b6512bd1f1 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:48.162059 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-a11c8504-d5df-4a88-a8ac-dc62df90be4d req-7fc188e2-1056-4ddb-aa5e-03b6512bd1f1 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:48.174219 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-a11c8504-d5df-4a88-a8ac-dc62df90be4d req-7fc188e2-1056-4ddb-aa5e-03b6512bd1f1 service nova] Creating event network-vif-deleted:e905a309-fe29-4762-880d-f6eb375da04f for instance 76deb7da-88aa-4c26-b55d-fd6432d1e680 on hv-cinder-84599 Aug 01 14:24:48.179516 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-a11c8504-d5df-4a88-a8ac-dc62df90be4d req-7fc188e2-1056-4ddb-aa5e-03b6512bd1f1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032743 Aug 01 14:24:48.180474 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 340/672] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:24:48.750775 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-73acb50c-d62a-482d-b7b6-0afad6340730 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:48.751711 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-73acb50c-d62a-482d-b7b6-0afad6340730 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:48.778234 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-73acb50c-d62a-482d-b7b6-0afad6340730 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:48.778771 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-73acb50c-d62a-482d-b7b6-0afad6340730 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:48.780992 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-73acb50c-d62a-482d-b7b6-0afad6340730 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:48.783435 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-73acb50c-d62a-482d-b7b6-0afad6340730 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:48.834078 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-73acb50c-d62a-482d-b7b6-0afad6340730 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:48.835045 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-73acb50c-d62a-482d-b7b6-0afad6340730 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:48.835777 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-73acb50c-d62a-482d-b7b6-0afad6340730 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lazy-loading 'fault' on Instance uuid 76deb7da-88aa-4c26-b55d-fd6432d1e680 {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:24:48.898937 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-73acb50c-d62a-482d-b7b6-0afad6340730 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:48.907156 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-73acb50c-d62a-482d-b7b6-0afad6340730 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:48.908712 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-73acb50c-d62a-482d-b7b6-0afad6340730 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:48.909858 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-73acb50c-d62a-482d-b7b6-0afad6340730 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 200 len: 1372 microversion: 2.20 time: 0.169748 Aug 01 14:24:48.910746 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 333/673] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:48 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:49.933078 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4b5d6b68-5c0c-42f4-b394-250bb6808f6a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:49.933879 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4b5d6b68-5c0c-42f4-b394-250bb6808f6a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:49.941293 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4b5d6b68-5c0c-42f4-b394-250bb6808f6a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:49.941740 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4b5d6b68-5c0c-42f4-b394-250bb6808f6a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:49.942520 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4b5d6b68-5c0c-42f4-b394-250bb6808f6a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:49.942953 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4b5d6b68-5c0c-42f4-b394-250bb6808f6a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:49.957706 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-4b5d6b68-5c0c-42f4-b394-250bb6808f6a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] HTTP exception thrown: Instance 76deb7da-88aa-4c26-b55d-fd6432d1e680 could not be found. Aug 01 14:24:49.960533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4b5d6b68-5c0c-42f4-b394-250bb6808f6a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Request method failure captured: Aug 01 14:24:49.960533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 HTTP/1.1 Aug 01 14:24:49.960533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept: application/json Aug 01 14:24:49.960533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Aug 01 14:24:49.960533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Connection: close Aug 01 14:24:49.960533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Length: 0 Aug 01 14:24:49.960533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Type: application/json Aug 01 14:24:49.960533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Host: 10.222.0.17 Aug 01 14:24:49.960533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Aug 01 14:24:49.960533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.10 Aug 01 14:24:49.960533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABi5-EnTXKMlVzWiQvuoM3Li_7Xt8e8pzyVSu3I8Ovwsb05jmHaJIhXIfloZhNdo4gAbu7GPWwvsJeTl480IhROVHmaghvN-qiUMKCq9B07l6XFEquo1vchDUYVb3d185Gvq7QLtXjaK73JfW_xulof1LYuTsbvm4u6bw3hZw57cR1h5ds Aug 01 14:24:49.960533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Aug 01 14:24:49.960533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Aug 01 14:24:49.960533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Aug 01 14:24:49.960533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Aug 01 14:24:49.960533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 14:24:49.960533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Aug 01 14:24:49.960533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Aug 01 14:24:49.960533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Id: 2fb1590048254549bb480d677892031f Aug 01 14:24:49.960533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-803629719 Aug 01 14:24:49.960533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Role: reader,member Aug 01 14:24:49.960533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Roles: reader,member Aug 01 14:24:49.962127 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2fb1590048254549bb480d677892031f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2fb1590048254549bb480d677892031f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2fb1590048254549bb480d677892031f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2fb1590048254549bb480d677892031f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:24:49.962127 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-AttachVolumeShelveTestJSON-803629719 Aug 01 14:24:49.962127 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 2fb1590048254549bb480d677892031f Aug 01 14:24:49.962127 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-803629719 Aug 01 14:24:49.962127 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User: tempest-AttachVolumeShelveTestJSON-803629719-project Aug 01 14:24:49.962127 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Aug 01 14:24:49.962127 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Aug 01 14:24:49.962127 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Id: fbaa67d901e34419b1616a8457fbd683 Aug 01 14:24:49.962127 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-AttachVolumeShelveTestJSON-803629719-project Aug 01 14:24:49.962127 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: method: > Aug 01 14:24:49.962127 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: exception: Instance 76deb7da-88aa-4c26-b55d-fd6432d1e680 could not be found. Aug 01 14:24:49.962127 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: action_args: {'id': '76deb7da-88aa-4c26-b55d-fd6432d1e680'} Aug 01 14:24:49.963184 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:24:49.963184 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:24:49.963184 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:24:49.963184 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:24:49.963184 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:24:49.963184 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:24:49.963184 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:24:49.963184 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:24:49.963184 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:24:49.963184 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:24:49.963184 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76deb7da-88aa-4c26-b55d-fd6432d1e680 could not be found. Aug 01 14:24:49.963184 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:24:49.963184 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:24:49.963184 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:24:49.963184 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:24:49.963184 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:24:49.963184 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:24:49.963184 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:24:49.963184 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:24:49.963184 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:24:49.965520 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:24:49.965520 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:24:49.965520 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:24:49.965520 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:24:49.965520 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:24:49.965520 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:24:49.965520 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:24:49.965520 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76deb7da-88aa-4c26-b55d-fd6432d1e680 could not be found. Aug 01 14:24:49.965520 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:24:49.965520 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:24:49.965520 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:24:49.965520 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:24:49.965520 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:24:49.965520 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:24:49.965520 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:24:49.965520 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:24:49.965520 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76deb7da-88aa-4c26-b55d-fd6432d1e680 could not be found. Aug 01 14:24:49.965520 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:24:49.967492 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4b5d6b68-5c0c-42f4-b394-250bb6808f6a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Returning 404 to user: Instance 76deb7da-88aa-4c26-b55d-fd6432d1e680 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:24:49.968446 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4b5d6b68-5c0c-42f4-b394-250bb6808f6a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 404 len: 111 microversion: 2.20 time: 0.039651 Aug 01 14:24:49.969613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 341/674] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:49 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:24:49.979808 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-32434f18-f71e-4b7d-abc8-eeae9734f3da tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '.version_select at 0x7f61853c7c10>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:50.000477 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-32434f18-f71e-4b7d-abc8-eeae9734f3da tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1434419082" status: 204 len: 0 microversion: 2.20 time: 0.025523 Aug 01 14:24:50.001053 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 334/675] 10.222.0.17 () {60 vars in 1262 bytes} [Mon Aug 1 14:24:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1434419082 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 14:24:50.760070 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-41ed6ed3-8924-4628-933e-6bd3716b987a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Action: 'create', calling method: .version_select at 0x7f6184c0c700>, body: {"keypair": {"name": "tempest-keypair-52270305", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFr1rF+2lzvQH5MKQOWjAqh5Mha8lzBVggCtVr3j2ZaxHA8tXsb8Y6unwJr0IwSxPsgbrka2qyqluDF1asNmNZeyiSZllV8CsFRfOyAx52/dv5ZmrXFT7nbd+oRW1fYxA=="}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:24:50.779183 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-41ed6ed3-8924-4628-933e-6bd3716b987a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Getting quotas for project 2fb1590048254549bb480d677892031f. Resources: {'key_pairs'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:24:50.784200 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-41ed6ed3-8924-4628-933e-6bd3716b987a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Getting quotas for user fbaa67d901e34419b1616a8457fbd683 and project 2fb1590048254549bb480d677892031f. Resources: {'key_pairs'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:24:50.820100 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-41ed6ed3-8924-4628-933e-6bd3716b987a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.065063 Aug 01 14:24:50.820701 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 342/676] 10.222.0.17 () {62 vars in 1200 bytes} [Mon Aug 1 14:24:50 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 67 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 01 14:24:52.422221 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-25145624-73e1-4596-b80e-f383e7d695a6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1116142989", "imageRef": "9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f50c02c-bb30-41aa-99c5-63e2fcd2c717"}], "security_groups": [{"name": "tempest-securitygroup--1401742086"}], "key_name": "tempest-keypair-52270305", "user_data": "}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:24:52.552978 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.network.neutron [None req-25145624-73e1-4596-b80e-f383e7d695a6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] validate_networks() for [('6f50c02c-bb30-41aa-99c5-63e2fcd2c717', None, None, None, None, None)] {{(pid=118133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:24:53.046071 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-25145624-73e1-4596-b80e-f383e7d695a6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Flavor limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:24:53.046549 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-25145624-73e1-4596-b80e-f383e7d695a6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Image limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:24:53.047055 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-25145624-73e1-4596-b80e-f383e7d695a6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Flavor pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:24:53.047666 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-25145624-73e1-4596-b80e-f383e7d695a6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Image pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:24:53.048084 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-25145624-73e1-4596-b80e-f383e7d695a6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:24:53.058802 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-25145624-73e1-4596-b80e-f383e7d695a6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:53.060143 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-25145624-73e1-4596-b80e-f383e7d695a6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:53.061210 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-25145624-73e1-4596-b80e-f383e7d695a6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:53.061710 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-25145624-73e1-4596-b80e-f383e7d695a6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:53.080994 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-25145624-73e1-4596-b80e-f383e7d695a6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Getting quotas for project 2fb1590048254549bb480d677892031f. Resources: {'instances', 'cores', 'ram'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:24:53.085953 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-25145624-73e1-4596-b80e-f383e7d695a6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Getting quotas for user fbaa67d901e34419b1616a8457fbd683 and project 2fb1590048254549bb480d677892031f. Resources: {'instances', 'cores', 'ram'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:24:53.098478 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-25145624-73e1-4596-b80e-f383e7d695a6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Going to run 1 instances... {{(pid=118133) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:24:53.100886 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-25145624-73e1-4596-b80e-f383e7d695a6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:24:53.152334 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-25145624-73e1-4596-b80e-f383e7d695a6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.735704 Aug 01 14:24:53.153152 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 335/677] 10.222.0.17 () {62 vars in 1188 bytes} [Mon Aug 1 14:24:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 01 14:24:53.166000 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2b5c7923-bec4-4ff1-90a1-8f13fb2066c0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:53.167634 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2b5c7923-bec4-4ff1-90a1-8f13fb2066c0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:53.257526 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-2b5c7923-bec4-4ff1-90a1-8f13fb2066c0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:53.270498 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-2b5c7923-bec4-4ff1-90a1-8f13fb2066c0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:53.273081 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-2b5c7923-bec4-4ff1-90a1-8f13fb2066c0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:53.278245 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2b5c7923-bec4-4ff1-90a1-8f13fb2066c0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1280 microversion: 2.20 time: 0.114869 Aug 01 14:24:53.279775 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 343/678] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:53 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1280 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:54.302944 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6b3e1039-4539-4e22-8b43-98270f1cd6e5 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:54.303738 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-6b3e1039-4539-4e22-8b43-98270f1cd6e5 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:54.313025 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6b3e1039-4539-4e22-8b43-98270f1cd6e5 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:54.313821 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6b3e1039-4539-4e22-8b43-98270f1cd6e5 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:54.314830 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6b3e1039-4539-4e22-8b43-98270f1cd6e5 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:54.315485 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6b3e1039-4539-4e22-8b43-98270f1cd6e5 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:54.409691 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6b3e1039-4539-4e22-8b43-98270f1cd6e5 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:54.435987 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6b3e1039-4539-4e22-8b43-98270f1cd6e5 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:54.438520 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6b3e1039-4539-4e22-8b43-98270f1cd6e5 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:54.448187 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6b3e1039-4539-4e22-8b43-98270f1cd6e5 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1340 microversion: 2.20 time: 0.149925 Aug 01 14:24:54.450255 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 336/679] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:54 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1340 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:55.475977 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0df1b0dd-3235-4cc8-a0c5-e5f74f11c326 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:55.478596 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0df1b0dd-3235-4cc8-a0c5-e5f74f11c326 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:55.489543 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0df1b0dd-3235-4cc8-a0c5-e5f74f11c326 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:55.490323 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0df1b0dd-3235-4cc8-a0c5-e5f74f11c326 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:55.491116 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0df1b0dd-3235-4cc8-a0c5-e5f74f11c326 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:55.491581 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0df1b0dd-3235-4cc8-a0c5-e5f74f11c326 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:55.615304 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0df1b0dd-3235-4cc8-a0c5-e5f74f11c326 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:55.626191 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0df1b0dd-3235-4cc8-a0c5-e5f74f11c326 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:55.628712 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0df1b0dd-3235-4cc8-a0c5-e5f74f11c326 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:55.630475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0df1b0dd-3235-4cc8-a0c5-e5f74f11c326 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1338 microversion: 2.20 time: 0.161514 Aug 01 14:24:55.635871 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 344/680] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:55 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1338 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:56.663700 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-60c3f387-9257-4398-a02f-0d4c9194ca2e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:56.670913 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-60c3f387-9257-4398-a02f-0d4c9194ca2e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:56.684096 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-60c3f387-9257-4398-a02f-0d4c9194ca2e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:56.684579 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-60c3f387-9257-4398-a02f-0d4c9194ca2e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:56.690865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-60c3f387-9257-4398-a02f-0d4c9194ca2e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:56.691715 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-60c3f387-9257-4398-a02f-0d4c9194ca2e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:56.907148 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-60c3f387-9257-4398-a02f-0d4c9194ca2e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:56.918269 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-60c3f387-9257-4398-a02f-0d4c9194ca2e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:56.920063 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-60c3f387-9257-4398-a02f-0d4c9194ca2e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:56.930393 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-60c3f387-9257-4398-a02f-0d4c9194ca2e tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1406 microversion: 2.20 time: 0.272019 Aug 01 14:24:56.931016 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 337/681] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:56 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1406 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:57.440201 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-ce577fe0-f781-4dd0-be2a-e21b4e9f33fb req-2d7a6eee-e2b2-4c23-8a4f-744e9864d1bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40a79ecf-b103-42e0-9cd6-d1daacb03f53", "tag": "0379a8d6-df19-44b8-a731-76a7821a7444"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:24:57.459828 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-ce577fe0-f781-4dd0-be2a-e21b4e9f33fb req-2d7a6eee-e2b2-4c23-8a4f-744e9864d1bc service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:57.460416 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-ce577fe0-f781-4dd0-be2a-e21b4e9f33fb req-2d7a6eee-e2b2-4c23-8a4f-744e9864d1bc service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:57.478063 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-ce577fe0-f781-4dd0-be2a-e21b4e9f33fb req-2d7a6eee-e2b2-4c23-8a4f-744e9864d1bc service nova] Creating event network-changed:0379a8d6-df19-44b8-a731-76a7821a7444 for instance 40a79ecf-b103-42e0-9cd6-d1daacb03f53 on hv-cinder-84599 Aug 01 14:24:57.487744 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-ce577fe0-f781-4dd0-be2a-e21b4e9f33fb req-2d7a6eee-e2b2-4c23-8a4f-744e9864d1bc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053493 Aug 01 14:24:57.490722 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 345/682] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:24:57.954176 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-89f1cd59-5e96-4e24-bbcc-41aad94dedc6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:57.954947 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-89f1cd59-5e96-4e24-bbcc-41aad94dedc6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:57.961961 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-89f1cd59-5e96-4e24-bbcc-41aad94dedc6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:57.962757 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-89f1cd59-5e96-4e24-bbcc-41aad94dedc6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:57.963771 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-89f1cd59-5e96-4e24-bbcc-41aad94dedc6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:57.964568 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-89f1cd59-5e96-4e24-bbcc-41aad94dedc6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:58.178911 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-89f1cd59-5e96-4e24-bbcc-41aad94dedc6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:58.191211 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-89f1cd59-5e96-4e24-bbcc-41aad94dedc6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:58.193193 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-89f1cd59-5e96-4e24-bbcc-41aad94dedc6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:58.194601 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-89f1cd59-5e96-4e24-bbcc-41aad94dedc6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1406 microversion: 2.20 time: 0.244410 Aug 01 14:24:58.195380 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 338/683] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:57 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:59.220681 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e89ca528-ca97-4060-bbee-793d9cb34b8d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:59.221293 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e89ca528-ca97-4060-bbee-793d9cb34b8d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:59.238729 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e89ca528-ca97-4060-bbee-793d9cb34b8d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:59.240454 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e89ca528-ca97-4060-bbee-793d9cb34b8d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:59.243034 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e89ca528-ca97-4060-bbee-793d9cb34b8d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:59.246026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e89ca528-ca97-4060-bbee-793d9cb34b8d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:59.508285 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e89ca528-ca97-4060-bbee-793d9cb34b8d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:59.518811 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e89ca528-ca97-4060-bbee-793d9cb34b8d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:59.520499 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e89ca528-ca97-4060-bbee-793d9cb34b8d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:59.522074 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e89ca528-ca97-4060-bbee-793d9cb34b8d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1406 microversion: 2.20 time: 0.307767 Aug 01 14:24:59.533125 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 346/684] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:59 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1406 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:25:00.548101 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-1b3c6972-ea7e-4a50-bed2-dcfed3e9e8a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:00.549339 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1b3c6972-ea7e-4a50-bed2-dcfed3e9e8a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:00.556172 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1b3c6972-ea7e-4a50-bed2-dcfed3e9e8a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:00.556623 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1b3c6972-ea7e-4a50-bed2-dcfed3e9e8a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:00.557396 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1b3c6972-ea7e-4a50-bed2-dcfed3e9e8a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:00.557824 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1b3c6972-ea7e-4a50-bed2-dcfed3e9e8a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:00.726974 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1b3c6972-ea7e-4a50-bed2-dcfed3e9e8a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:00.736145 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1b3c6972-ea7e-4a50-bed2-dcfed3e9e8a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:00.737843 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1b3c6972-ea7e-4a50-bed2-dcfed3e9e8a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:00.739055 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-1b3c6972-ea7e-4a50-bed2-dcfed3e9e8a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1406 microversion: 2.20 time: 0.196918 Aug 01 14:25:00.739708 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 339/685] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:00 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:25:01.770130 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-60968614-6e82-4e45-a469-cfe92c9fdc6c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:01.772558 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-60968614-6e82-4e45-a469-cfe92c9fdc6c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:01.788108 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-60968614-6e82-4e45-a469-cfe92c9fdc6c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:01.789200 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-60968614-6e82-4e45-a469-cfe92c9fdc6c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:01.791052 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-60968614-6e82-4e45-a469-cfe92c9fdc6c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:01.792144 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-60968614-6e82-4e45-a469-cfe92c9fdc6c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:01.985865 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-60968614-6e82-4e45-a469-cfe92c9fdc6c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:01.995233 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-60968614-6e82-4e45-a469-cfe92c9fdc6c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:01.998166 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-60968614-6e82-4e45-a469-cfe92c9fdc6c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:01.999305 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-60968614-6e82-4e45-a469-cfe92c9fdc6c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1406 microversion: 2.20 time: 0.238374 Aug 01 14:25:02.014020 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 347/686] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:01 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1406 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:25:02.084645 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9ed8dd1e-c16a-4cf1-b7b4-2b4f6543e7b0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6360ecf5-f1af-47a6-ad3c-f62caf62274d"}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:02.087892 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9ed8dd1e-c16a-4cf1-b7b4-2b4f6543e7b0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:02.100119 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9ed8dd1e-c16a-4cf1-b7b4-2b4f6543e7b0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:02.101527 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9ed8dd1e-c16a-4cf1-b7b4-2b4f6543e7b0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:02.104985 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9ed8dd1e-c16a-4cf1-b7b4-2b4f6543e7b0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:02.105748 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9ed8dd1e-c16a-4cf1-b7b4-2b4f6543e7b0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:02.478959 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9ed8dd1e-c16a-4cf1-b7b4-2b4f6543e7b0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "POST /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.399473 Aug 01 14:25:02.480422 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 340/687] 10.222.0.17 () {60 vars in 1323 bytes} [Mon Aug 1 14:25:02 2022] POST /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be/os-volume_attachments => generated 194 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:25:03.022857 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b3da94f5-3a2c-4f38-aa1c-3c6df1211814 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:03.024083 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b3da94f5-3a2c-4f38-aa1c-3c6df1211814 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:03.034832 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b3da94f5-3a2c-4f38-aa1c-3c6df1211814 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:03.040892 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b3da94f5-3a2c-4f38-aa1c-3c6df1211814 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:03.041900 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b3da94f5-3a2c-4f38-aa1c-3c6df1211814 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:03.042417 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b3da94f5-3a2c-4f38-aa1c-3c6df1211814 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:03.263372 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=6 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:03.303404 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b3da94f5-3a2c-4f38-aa1c-3c6df1211814 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:03.314002 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b3da94f5-3a2c-4f38-aa1c-3c6df1211814 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:03.315905 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b3da94f5-3a2c-4f38-aa1c-3c6df1211814 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:03.317289 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b3da94f5-3a2c-4f38-aa1c-3c6df1211814 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1406 microversion: 2.20 time: 0.298625 Aug 01 14:25:03.336163 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 348/688] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:03 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1406 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:25:04.127072 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:04.127692 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=6 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:04.132163 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-dde47c0d-da34-45ef-a440-8569e59f6802 req-6b67752d-e6fc-448b-b4d3-6b8555e323c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40a79ecf-b103-42e0-9cd6-d1daacb03f53", "name": "network-vif-plugged", "status": "completed", "tag": "0379a8d6-df19-44b8-a731-76a7821a7444"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:04.149528 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-dde47c0d-da34-45ef-a440-8569e59f6802 req-6b67752d-e6fc-448b-b4d3-6b8555e323c9 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:04.150449 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-dde47c0d-da34-45ef-a440-8569e59f6802 req-6b67752d-e6fc-448b-b4d3-6b8555e323c9 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:04.163925 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-dde47c0d-da34-45ef-a440-8569e59f6802 req-6b67752d-e6fc-448b-b4d3-6b8555e323c9 service nova] Creating event network-vif-plugged:0379a8d6-df19-44b8-a731-76a7821a7444 for instance 40a79ecf-b103-42e0-9cd6-d1daacb03f53 on hv-cinder-84599 Aug 01 14:25:04.171911 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-dde47c0d-da34-45ef-a440-8569e59f6802 req-6b67752d-e6fc-448b-b4d3-6b8555e323c9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045848 Aug 01 14:25:04.173173 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 341/689] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:25:04.348805 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d3918597-53ba-41d9-8bde-26d07e263d86 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:04.349514 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d3918597-53ba-41d9-8bde-26d07e263d86 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:04.375480 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d3918597-53ba-41d9-8bde-26d07e263d86 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:04.376724 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d3918597-53ba-41d9-8bde-26d07e263d86 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:04.377586 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d3918597-53ba-41d9-8bde-26d07e263d86 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:04.378215 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d3918597-53ba-41d9-8bde-26d07e263d86 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:04.710188 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d3918597-53ba-41d9-8bde-26d07e263d86 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:04.718675 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d3918597-53ba-41d9-8bde-26d07e263d86 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:04.721697 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d3918597-53ba-41d9-8bde-26d07e263d86 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:04.723050 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d3918597-53ba-41d9-8bde-26d07e263d86 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1406 microversion: 2.20 time: 0.383012 Aug 01 14:25:04.723821 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 349/690] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:04 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1406 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:25:05.748861 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-186e75cf-fc97-4ebc-b37b-9ab84183a331 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:05.750933 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-186e75cf-fc97-4ebc-b37b-9ab84183a331 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:05.758909 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-186e75cf-fc97-4ebc-b37b-9ab84183a331 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:05.759357 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-186e75cf-fc97-4ebc-b37b-9ab84183a331 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:05.760190 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-186e75cf-fc97-4ebc-b37b-9ab84183a331 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:05.760625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-186e75cf-fc97-4ebc-b37b-9ab84183a331 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:05.928240 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-186e75cf-fc97-4ebc-b37b-9ab84183a331 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:05.940335 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-186e75cf-fc97-4ebc-b37b-9ab84183a331 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:05.941841 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-186e75cf-fc97-4ebc-b37b-9ab84183a331 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:05.942943 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-186e75cf-fc97-4ebc-b37b-9ab84183a331 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1406 microversion: 2.20 time: 0.199975 Aug 01 14:25:05.943710 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 342/691] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:05 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:25:06.965665 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ebe24e4f-87fd-4b24-a041-5232341f531d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:06.966956 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ebe24e4f-87fd-4b24-a041-5232341f531d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:06.977250 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ebe24e4f-87fd-4b24-a041-5232341f531d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:06.977798 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ebe24e4f-87fd-4b24-a041-5232341f531d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:06.978640 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ebe24e4f-87fd-4b24-a041-5232341f531d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:06.979155 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ebe24e4f-87fd-4b24-a041-5232341f531d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:07.133877 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ebe24e4f-87fd-4b24-a041-5232341f531d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:07.144922 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ebe24e4f-87fd-4b24-a041-5232341f531d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:07.146417 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ebe24e4f-87fd-4b24-a041-5232341f531d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:07.147684 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ebe24e4f-87fd-4b24-a041-5232341f531d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1599 microversion: 2.20 time: 0.186052 Aug 01 14:25:07.148164 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 350/692] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:06 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1599 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:25:07.170342 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-be963af7-2524-45ae-a945-cbdd3ca0cabe tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:07.171043 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-be963af7-2524-45ae-a945-cbdd3ca0cabe tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:07.178290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-be963af7-2524-45ae-a945-cbdd3ca0cabe tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:07.178967 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-be963af7-2524-45ae-a945-cbdd3ca0cabe tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:07.179965 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-be963af7-2524-45ae-a945-cbdd3ca0cabe tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:07.180553 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-be963af7-2524-45ae-a945-cbdd3ca0cabe tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:07.275407 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-be963af7-2524-45ae-a945-cbdd3ca0cabe tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.108786 Aug 01 14:25:07.283634 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 343/693] 10.222.0.17 () {60 vars in 1316 bytes} [Mon Aug 1 14:25:07 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:25:08.374895 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-95c23c66-b688-4de5-aa72-8878a9ca9b76 req-31ffe846-6035-4705-b71d-4c33d46ac946 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40a79ecf-b103-42e0-9cd6-d1daacb03f53", "tag": "0379a8d6-df19-44b8-a731-76a7821a7444"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:08.393928 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-95c23c66-b688-4de5-aa72-8878a9ca9b76 req-31ffe846-6035-4705-b71d-4c33d46ac946 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:08.394371 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-95c23c66-b688-4de5-aa72-8878a9ca9b76 req-31ffe846-6035-4705-b71d-4c33d46ac946 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:08.409210 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-95c23c66-b688-4de5-aa72-8878a9ca9b76 req-31ffe846-6035-4705-b71d-4c33d46ac946 service nova] Creating event network-changed:0379a8d6-df19-44b8-a731-76a7821a7444 for instance 40a79ecf-b103-42e0-9cd6-d1daacb03f53 on hv-cinder-84599 Aug 01 14:25:08.417309 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-95c23c66-b688-4de5-aa72-8878a9ca9b76 req-31ffe846-6035-4705-b71d-4c33d46ac946 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046264 Aug 01 14:25:08.418267 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 351/694] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:25:09.086878 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-634a79b3-011c-4baf-8960-63a560716343 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Action: 'create', calling method: .version_select at 0x7f61855410d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2088314358", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHX2XCjiPvbRVa8bY6zod2vB8sVN1q08SyTQrRKxQ4FuhsxYiUrDBTQP4MVrgHwwpgm25xBeCiEpPfuTf/Up3y3aqb7gtOV4nxIqlfBrApXPa30TAspPTUdEWccmJCcVYg=="}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:09.103619 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-634a79b3-011c-4baf-8960-63a560716343 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Getting quotas for project 83c251299d274471b80df4ff026b0102. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:25:09.107839 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-634a79b3-011c-4baf-8960-63a560716343 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Getting quotas for user 00393da6a11e4d77b5ad25b904f7187b and project 83c251299d274471b80df4ff026b0102. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:25:09.132019 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-634a79b3-011c-4baf-8960-63a560716343 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.049428 Aug 01 14:25:09.132647 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 344/695] 10.222.0.17 () {60 vars in 1159 bytes} [Mon Aug 1 14:25:09 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:25:09.184149 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c1a872d6-4688-42fc-a1ad-67ef6e255259 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1212990860", "imageRef": "0fc91721-2855-45e0-be71-49b0d27cbde3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2088314358", "networks": [{"uuid": "a6d28b8f-c11e-4d5e-9b52-bf0f09b9e5f5"}]}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:09.256711 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.network.neutron [None req-c1a872d6-4688-42fc-a1ad-67ef6e255259 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] validate_networks() for [('a6d28b8f-c11e-4d5e-9b52-bf0f09b9e5f5', None, None, None, None, None)] {{(pid=118132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:25:10.177810 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-c1a872d6-4688-42fc-a1ad-67ef6e255259 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Flavor limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:25:10.178412 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-c1a872d6-4688-42fc-a1ad-67ef6e255259 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Image limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:25:10.178785 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-c1a872d6-4688-42fc-a1ad-67ef6e255259 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Flavor pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:25:10.179247 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-c1a872d6-4688-42fc-a1ad-67ef6e255259 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Image pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:25:10.179887 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-c1a872d6-4688-42fc-a1ad-67ef6e255259 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:25:10.180733 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e21a36ba-66e0-4b65-bd68-592f08e6274b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:10.182966 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e21a36ba-66e0-4b65-bd68-592f08e6274b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:10.190894 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c1a872d6-4688-42fc-a1ad-67ef6e255259 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:10.191226 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e21a36ba-66e0-4b65-bd68-592f08e6274b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:10.191769 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e21a36ba-66e0-4b65-bd68-592f08e6274b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:10.191952 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c1a872d6-4688-42fc-a1ad-67ef6e255259 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:10.192558 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e21a36ba-66e0-4b65-bd68-592f08e6274b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:10.192861 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c1a872d6-4688-42fc-a1ad-67ef6e255259 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:10.192986 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e21a36ba-66e0-4b65-bd68-592f08e6274b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:10.193641 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c1a872d6-4688-42fc-a1ad-67ef6e255259 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:10.212172 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-c1a872d6-4688-42fc-a1ad-67ef6e255259 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Getting quotas for project 83c251299d274471b80df4ff026b0102. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:25:10.216703 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-e21a36ba-66e0-4b65-bd68-592f08e6274b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lazy-loading 'flavor' on Instance uuid 5664fd60-279c-4671-9a77-a5bc99baf7be {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:25:10.217069 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-c1a872d6-4688-42fc-a1ad-67ef6e255259 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Getting quotas for user 00393da6a11e4d77b5ad25b904f7187b and project 83c251299d274471b80df4ff026b0102. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:25:10.231187 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c1a872d6-4688-42fc-a1ad-67ef6e255259 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Going to run 1 instances... {{(pid=118132) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:25:10.234183 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c1a872d6-4688-42fc-a1ad-67ef6e255259 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0fc91721-2855-45e0-be71-49b0d27cbde3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:25:10.285925 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c1a872d6-4688-42fc-a1ad-67ef6e255259 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.105946 Aug 01 14:25:10.286817 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 352/696] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Aug 1 14:25:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:25:10.299246 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-21fd7430-3491-4109-8461-352916e2c4a2 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:10.299874 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-21fd7430-3491-4109-8461-352916e2c4a2 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:10.326178 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:10.365901 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-21fd7430-3491-4109-8461-352916e2c4a2 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:10.377046 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e21a36ba-66e0-4b65-bd68-592f08e6274b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "POST /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be/action" status: 200 len: 32 microversion: 2.1 time: 0.200289 Aug 01 14:25:10.377382 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-21fd7430-3491-4109-8461-352916e2c4a2 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1259 microversion: 2.1 time: 0.082514 Aug 01 14:25:10.378013 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 353/697] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:10 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1259 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:25:10.378721 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 345/698] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Aug 1 14:25:10 2022] POST /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be/action => generated 32 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 01 14:25:10.395204 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-fcbe2939-b47a-4742-8498-a898ba718357 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:10.395943 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-fcbe2939-b47a-4742-8498-a898ba718357 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:10.403735 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fcbe2939-b47a-4742-8498-a898ba718357 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:10.404191 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fcbe2939-b47a-4742-8498-a898ba718357 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:10.405501 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fcbe2939-b47a-4742-8498-a898ba718357 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:10.406975 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fcbe2939-b47a-4742-8498-a898ba718357 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:10.636776 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-fcbe2939-b47a-4742-8498-a898ba718357 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:10.656365 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-fcbe2939-b47a-4742-8498-a898ba718357 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1735 microversion: 2.1 time: 0.267399 Aug 01 14:25:10.657426 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 354/699] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:10 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1735 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:11.402991 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-20944202-19d2-4937-a07a-b7abbaf16764 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:11.403811 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-20944202-19d2-4937-a07a-b7abbaf16764 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:11.410064 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-20944202-19d2-4937-a07a-b7abbaf16764 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:11.410551 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-20944202-19d2-4937-a07a-b7abbaf16764 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:11.411327 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-20944202-19d2-4937-a07a-b7abbaf16764 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:11.411806 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-20944202-19d2-4937-a07a-b7abbaf16764 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:11.487094 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-20944202-19d2-4937-a07a-b7abbaf16764 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:11.494571 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-20944202-19d2-4937-a07a-b7abbaf16764 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1319 microversion: 2.1 time: 0.096890 Aug 01 14:25:11.495150 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 346/700] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:11 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1319 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:11.677953 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6e6dbcfa-1400-4f00-b2b1-d2c71a87f0ca tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:11.679171 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-6e6dbcfa-1400-4f00-b2b1-d2c71a87f0ca tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:11.686139 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6e6dbcfa-1400-4f00-b2b1-d2c71a87f0ca tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:11.687815 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6e6dbcfa-1400-4f00-b2b1-d2c71a87f0ca tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:11.688834 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6e6dbcfa-1400-4f00-b2b1-d2c71a87f0ca tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:11.689273 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6e6dbcfa-1400-4f00-b2b1-d2c71a87f0ca tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:11.960639 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6e6dbcfa-1400-4f00-b2b1-d2c71a87f0ca tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:11.972931 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6e6dbcfa-1400-4f00-b2b1-d2c71a87f0ca tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1735 microversion: 2.1 time: 0.298786 Aug 01 14:25:11.984546 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 355/701] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:11 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1735 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:12.515262 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5cc9d6bd-8d48-4708-9eb6-2ac3492c742f tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:12.515903 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5cc9d6bd-8d48-4708-9eb6-2ac3492c742f tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:12.524498 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5cc9d6bd-8d48-4708-9eb6-2ac3492c742f tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:12.524871 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5cc9d6bd-8d48-4708-9eb6-2ac3492c742f tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:12.525663 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5cc9d6bd-8d48-4708-9eb6-2ac3492c742f tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:12.526293 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5cc9d6bd-8d48-4708-9eb6-2ac3492c742f tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:12.609701 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5cc9d6bd-8d48-4708-9eb6-2ac3492c742f tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:12.622218 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5cc9d6bd-8d48-4708-9eb6-2ac3492c742f tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1317 microversion: 2.1 time: 0.110759 Aug 01 14:25:12.624883 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 347/702] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:12 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1317 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:12.995044 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-fdd78694-7eee-42c2-a20d-d705ca3bf7bb tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:12.995770 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-fdd78694-7eee-42c2-a20d-d705ca3bf7bb tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:13.003026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fdd78694-7eee-42c2-a20d-d705ca3bf7bb tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:13.003582 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fdd78694-7eee-42c2-a20d-d705ca3bf7bb tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:13.004423 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fdd78694-7eee-42c2-a20d-d705ca3bf7bb tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:13.004942 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fdd78694-7eee-42c2-a20d-d705ca3bf7bb tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:13.334510 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-fdd78694-7eee-42c2-a20d-d705ca3bf7bb tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:13.343109 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-fdd78694-7eee-42c2-a20d-d705ca3bf7bb tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1735 microversion: 2.1 time: 0.352453 Aug 01 14:25:13.343715 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 356/703] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:12 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1735 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:13.647721 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c9e77d4c-44a7-4b51-a42d-5c1204ed0d9d tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:13.648254 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c9e77d4c-44a7-4b51-a42d-5c1204ed0d9d tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:13.655271 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c9e77d4c-44a7-4b51-a42d-5c1204ed0d9d tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:13.656502 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c9e77d4c-44a7-4b51-a42d-5c1204ed0d9d tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:13.657280 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c9e77d4c-44a7-4b51-a42d-5c1204ed0d9d tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:13.657716 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c9e77d4c-44a7-4b51-a42d-5c1204ed0d9d tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:13.809099 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c9e77d4c-44a7-4b51-a42d-5c1204ed0d9d tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:13.816762 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c9e77d4c-44a7-4b51-a42d-5c1204ed0d9d tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1359 microversion: 2.1 time: 0.173496 Aug 01 14:25:13.830488 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 348/704] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:13 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:14.364752 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-618a9776-7b5e-4d13-962d-5627d200f8ef tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:14.365599 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-618a9776-7b5e-4d13-962d-5627d200f8ef tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:14.369810 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:14.373860 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-618a9776-7b5e-4d13-962d-5627d200f8ef tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:14.374900 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-618a9776-7b5e-4d13-962d-5627d200f8ef tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:14.375862 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-618a9776-7b5e-4d13-962d-5627d200f8ef tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:14.376284 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-618a9776-7b5e-4d13-962d-5627d200f8ef tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:14.379878 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:14.530652 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-618a9776-7b5e-4d13-962d-5627d200f8ef tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:14.538954 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-618a9776-7b5e-4d13-962d-5627d200f8ef tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1735 microversion: 2.1 time: 0.177980 Aug 01 14:25:14.539559 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 357/705] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:14 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:14.837985 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-75ba68f4-201b-4fe8-8e26-f210f3bba4a3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:14.838608 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-75ba68f4-201b-4fe8-8e26-f210f3bba4a3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:14.841084 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:14.846848 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-75ba68f4-201b-4fe8-8e26-f210f3bba4a3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:14.847295 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-75ba68f4-201b-4fe8-8e26-f210f3bba4a3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:14.848199 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-75ba68f4-201b-4fe8-8e26-f210f3bba4a3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:14.848680 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-75ba68f4-201b-4fe8-8e26-f210f3bba4a3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:15.046711 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-75ba68f4-201b-4fe8-8e26-f210f3bba4a3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:15.054445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-75ba68f4-201b-4fe8-8e26-f210f3bba4a3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1359 microversion: 2.1 time: 0.220294 Aug 01 14:25:15.055075 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 349/706] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:14 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1359 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:15.564571 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5cc44f60-b4ac-4037-a5fc-6abd3163b83e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:15.565307 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5cc44f60-b4ac-4037-a5fc-6abd3163b83e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:15.572023 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5cc44f60-b4ac-4037-a5fc-6abd3163b83e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:15.572467 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5cc44f60-b4ac-4037-a5fc-6abd3163b83e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:15.573361 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5cc44f60-b4ac-4037-a5fc-6abd3163b83e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:15.573813 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5cc44f60-b4ac-4037-a5fc-6abd3163b83e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:15.737312 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5cc44f60-b4ac-4037-a5fc-6abd3163b83e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:15.746317 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5cc44f60-b4ac-4037-a5fc-6abd3163b83e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1735 microversion: 2.1 time: 0.185595 Aug 01 14:25:15.747114 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 358/707] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:15 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:16.018444 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d933b85f-5c70-485b-be18-df9a43b16414 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:16.019096 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d933b85f-5c70-485b-be18-df9a43b16414 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:16.025716 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d933b85f-5c70-485b-be18-df9a43b16414 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:16.026166 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d933b85f-5c70-485b-be18-df9a43b16414 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:16.026978 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d933b85f-5c70-485b-be18-df9a43b16414 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:16.027417 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d933b85f-5c70-485b-be18-df9a43b16414 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:16.052559 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d933b85f-5c70-485b-be18-df9a43b16414 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39/ips" status: 200 len: 149 microversion: 2.1 time: 0.038508 Aug 01 14:25:16.053241 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 350/708] 10.222.0.17 () {58 vars in 1248 bytes} [Mon Aug 1 14:25:16 2022] GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:25:16.075441 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-88069c2a-19dc-411e-ad89-682a9584b4ff tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:16.076129 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-88069c2a-19dc-411e-ad89-682a9584b4ff tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:16.082595 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-88069c2a-19dc-411e-ad89-682a9584b4ff tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:16.083037 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-88069c2a-19dc-411e-ad89-682a9584b4ff tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:16.087687 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-88069c2a-19dc-411e-ad89-682a9584b4ff tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:16.088145 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-88069c2a-19dc-411e-ad89-682a9584b4ff tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:16.262496 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-88069c2a-19dc-411e-ad89-682a9584b4ff tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:16.270646 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-88069c2a-19dc-411e-ad89-682a9584b4ff tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1359 microversion: 2.1 time: 0.198897 Aug 01 14:25:16.271381 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 359/709] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:16 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:16.768331 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-39be8842-040a-4d46-a6e8-30ab2b6053ac tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:16.769003 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-39be8842-040a-4d46-a6e8-30ab2b6053ac tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:16.775873 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-39be8842-040a-4d46-a6e8-30ab2b6053ac tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:16.776035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-39be8842-040a-4d46-a6e8-30ab2b6053ac tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:16.778283 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-39be8842-040a-4d46-a6e8-30ab2b6053ac tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:16.778728 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-39be8842-040a-4d46-a6e8-30ab2b6053ac tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:16.935256 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-39be8842-040a-4d46-a6e8-30ab2b6053ac tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:16.946289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-39be8842-040a-4d46-a6e8-30ab2b6053ac tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1735 microversion: 2.1 time: 0.181936 Aug 01 14:25:16.951252 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 351/710] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:16 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:17.293079 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5221fa4f-51b1-4f6f-ab7e-2a290c3f4c13 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:17.293712 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5221fa4f-51b1-4f6f-ab7e-2a290c3f4c13 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:17.301502 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5221fa4f-51b1-4f6f-ab7e-2a290c3f4c13 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:17.301940 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5221fa4f-51b1-4f6f-ab7e-2a290c3f4c13 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:17.302738 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5221fa4f-51b1-4f6f-ab7e-2a290c3f4c13 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:17.303189 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5221fa4f-51b1-4f6f-ab7e-2a290c3f4c13 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:17.462550 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5221fa4f-51b1-4f6f-ab7e-2a290c3f4c13 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:17.475734 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5221fa4f-51b1-4f6f-ab7e-2a290c3f4c13 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1359 microversion: 2.1 time: 0.186080 Aug 01 14:25:17.475734 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 360/711] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:17 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:17.487155 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-2eae2384-e965-4788-87f4-7ceddcb37647 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9afa2bd3-ad94-4ee2-8080-3f2d22998843"}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:17.493562 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-2eae2384-e965-4788-87f4-7ceddcb37647 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:17.501527 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2eae2384-e965-4788-87f4-7ceddcb37647 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:17.501981 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2eae2384-e965-4788-87f4-7ceddcb37647 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:17.502782 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2eae2384-e965-4788-87f4-7ceddcb37647 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:17.503218 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2eae2384-e965-4788-87f4-7ceddcb37647 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:17.970259 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-088e0de2-e983-4e7e-a019-f601ed156129 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:17.970823 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-088e0de2-e983-4e7e-a019-f601ed156129 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:17.977134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-088e0de2-e983-4e7e-a019-f601ed156129 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:17.977587 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-088e0de2-e983-4e7e-a019-f601ed156129 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:17.978522 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-088e0de2-e983-4e7e-a019-f601ed156129 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:17.978803 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-088e0de2-e983-4e7e-a019-f601ed156129 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:18.117185 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-088e0de2-e983-4e7e-a019-f601ed156129 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:18.127086 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-088e0de2-e983-4e7e-a019-f601ed156129 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1735 microversion: 2.1 time: 0.161642 Aug 01 14:25:18.127699 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 361/712] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:17 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:25:18.495856 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5f3147f9-19f5-4bb7-acee-bce6d7d6ee7f tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:18.496680 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5f3147f9-19f5-4bb7-acee-bce6d7d6ee7f tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:18.503616 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5f3147f9-19f5-4bb7-acee-bce6d7d6ee7f tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:18.504071 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5f3147f9-19f5-4bb7-acee-bce6d7d6ee7f tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:18.504851 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5f3147f9-19f5-4bb7-acee-bce6d7d6ee7f tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:18.505285 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5f3147f9-19f5-4bb7-acee-bce6d7d6ee7f tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:18.671579 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5f3147f9-19f5-4bb7-acee-bce6d7d6ee7f tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:18.679164 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5f3147f9-19f5-4bb7-acee-bce6d7d6ee7f tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1359 microversion: 2.1 time: 0.187330 Aug 01 14:25:18.679967 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 362/713] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:18 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:25:19.115878 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=4 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:19.148174 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-cd04ed8c-f32b-48c6-91a9-8838aec8072e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:19.148783 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-cd04ed8c-f32b-48c6-91a9-8838aec8072e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:19.154904 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cd04ed8c-f32b-48c6-91a9-8838aec8072e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:19.155355 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cd04ed8c-f32b-48c6-91a9-8838aec8072e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:19.156169 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cd04ed8c-f32b-48c6-91a9-8838aec8072e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:19.156605 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cd04ed8c-f32b-48c6-91a9-8838aec8072e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:19.294424 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-cd04ed8c-f32b-48c6-91a9-8838aec8072e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:19.302847 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-cd04ed8c-f32b-48c6-91a9-8838aec8072e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1735 microversion: 2.1 time: 0.158446 Aug 01 14:25:19.303666 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 363/714] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:19 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:25:19.702906 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-83848a0c-28cf-4c62-8cd6-3b7b4dec5b69 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:19.703599 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-83848a0c-28cf-4c62-8cd6-3b7b4dec5b69 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:19.710083 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-83848a0c-28cf-4c62-8cd6-3b7b4dec5b69 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:19.710535 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-83848a0c-28cf-4c62-8cd6-3b7b4dec5b69 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:19.711300 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-83848a0c-28cf-4c62-8cd6-3b7b4dec5b69 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:19.711758 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-83848a0c-28cf-4c62-8cd6-3b7b4dec5b69 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:19.841257 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-83848a0c-28cf-4c62-8cd6-3b7b4dec5b69 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:19.848930 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-83848a0c-28cf-4c62-8cd6-3b7b4dec5b69 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1359 microversion: 2.1 time: 0.150954 Aug 01 14:25:19.849484 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 364/715] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:19 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:25:20.284157 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-2eae2384-e965-4788-87f4-7ceddcb37647 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "POST /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.801011 Aug 01 14:25:20.285318 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 352/716] 10.222.0.17 () {60 vars in 1323 bytes} [Mon Aug 1 14:25:17 2022] POST /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39/os-volume_attachments => generated 194 bytes in 2803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:25:20.323713 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-af86d453-00dd-48c8-8857-045b9911d10d tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:20.324300 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-af86d453-00dd-48c8-8857-045b9911d10d tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:20.329629 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=2 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:20.331213 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-af86d453-00dd-48c8-8857-045b9911d10d tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:20.332212 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-af86d453-00dd-48c8-8857-045b9911d10d tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:20.332455 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-af86d453-00dd-48c8-8857-045b9911d10d tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:20.332939 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-af86d453-00dd-48c8-8857-045b9911d10d tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:20.370726 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=8 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:20.692268 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-af86d453-00dd-48c8-8857-045b9911d10d tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:20.700881 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-af86d453-00dd-48c8-8857-045b9911d10d tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1735 microversion: 2.1 time: 0.380969 Aug 01 14:25:20.701457 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 365/717] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:20 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1735 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:20.872141 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-795d41fa-d9cc-402e-ba6b-dcb6c00f151e tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:20.872855 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-795d41fa-d9cc-402e-ba6b-dcb6c00f151e tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:20.879859 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-795d41fa-d9cc-402e-ba6b-dcb6c00f151e tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:20.880299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-795d41fa-d9cc-402e-ba6b-dcb6c00f151e tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:20.881072 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-795d41fa-d9cc-402e-ba6b-dcb6c00f151e tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:20.881572 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-795d41fa-d9cc-402e-ba6b-dcb6c00f151e tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:21.044948 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-795d41fa-d9cc-402e-ba6b-dcb6c00f151e tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:21.052696 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-795d41fa-d9cc-402e-ba6b-dcb6c00f151e tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1359 microversion: 2.1 time: 0.185011 Aug 01 14:25:21.053271 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 353/718] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:20 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:21.056422 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-cc0c511c-04a4-4057-a0a8-3e2c15c84304 req-ae4142e5-c0b0-4423-92f2-b18edb10530c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75578a42-6025-4833-8349-dd37db5a195f", "tag": "e829424e-7724-42ac-b5c9-19446ad3fa09"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:21.067003 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-cc0c511c-04a4-4057-a0a8-3e2c15c84304 req-ae4142e5-c0b0-4423-92f2-b18edb10530c service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:21.067448 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-cc0c511c-04a4-4057-a0a8-3e2c15c84304 req-ae4142e5-c0b0-4423-92f2-b18edb10530c service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:21.079162 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-cc0c511c-04a4-4057-a0a8-3e2c15c84304 req-ae4142e5-c0b0-4423-92f2-b18edb10530c service nova] Creating event network-changed:e829424e-7724-42ac-b5c9-19446ad3fa09 for instance 75578a42-6025-4833-8349-dd37db5a195f on hv-cinder-84599 Aug 01 14:25:21.084268 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-cc0c511c-04a4-4057-a0a8-3e2c15c84304 req-ae4142e5-c0b0-4423-92f2-b18edb10530c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031876 Aug 01 14:25:21.085030 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 366/719] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:25:21.722178 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-297a940e-d9f9-4a5d-ba99-ed9f9abb881e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:21.722782 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-297a940e-d9f9-4a5d-ba99-ed9f9abb881e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:21.729335 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-297a940e-d9f9-4a5d-ba99-ed9f9abb881e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:21.729788 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-297a940e-d9f9-4a5d-ba99-ed9f9abb881e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:21.730551 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-297a940e-d9f9-4a5d-ba99-ed9f9abb881e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:21.731209 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-297a940e-d9f9-4a5d-ba99-ed9f9abb881e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:21.868453 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-297a940e-d9f9-4a5d-ba99-ed9f9abb881e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:21.876299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-297a940e-d9f9-4a5d-ba99-ed9f9abb881e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1735 microversion: 2.1 time: 0.158695 Aug 01 14:25:21.876868 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 354/720] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:21 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:22.075215 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ffd45be0-fc0d-4ad0-a10a-9a090e7f7398 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:22.076065 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ffd45be0-fc0d-4ad0-a10a-9a090e7f7398 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:22.083126 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ffd45be0-fc0d-4ad0-a10a-9a090e7f7398 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:22.083616 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ffd45be0-fc0d-4ad0-a10a-9a090e7f7398 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:22.084395 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ffd45be0-fc0d-4ad0-a10a-9a090e7f7398 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:22.084827 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ffd45be0-fc0d-4ad0-a10a-9a090e7f7398 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:22.378394 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ffd45be0-fc0d-4ad0-a10a-9a090e7f7398 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:22.386628 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ffd45be0-fc0d-4ad0-a10a-9a090e7f7398 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1359 microversion: 2.1 time: 0.316193 Aug 01 14:25:22.387199 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 367/721] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:22 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1359 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:22.898265 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f887bd88-0bd0-4225-b74e-7881a0a88ab1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:22.898851 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f887bd88-0bd0-4225-b74e-7881a0a88ab1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:22.906129 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f887bd88-0bd0-4225-b74e-7881a0a88ab1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:22.906565 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f887bd88-0bd0-4225-b74e-7881a0a88ab1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:22.907315 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f887bd88-0bd0-4225-b74e-7881a0a88ab1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:22.907771 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f887bd88-0bd0-4225-b74e-7881a0a88ab1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:23.043160 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f887bd88-0bd0-4225-b74e-7881a0a88ab1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:23.052745 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f887bd88-0bd0-4225-b74e-7881a0a88ab1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1735 microversion: 2.1 time: 0.158367 Aug 01 14:25:23.053321 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 355/722] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:22 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:23.407981 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-12ef1287-b4bd-4abb-89d7-d8aeaf454ce3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:23.408577 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-12ef1287-b4bd-4abb-89d7-d8aeaf454ce3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:23.415644 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-12ef1287-b4bd-4abb-89d7-d8aeaf454ce3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:23.416095 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-12ef1287-b4bd-4abb-89d7-d8aeaf454ce3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:23.416859 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-12ef1287-b4bd-4abb-89d7-d8aeaf454ce3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:23.417292 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-12ef1287-b4bd-4abb-89d7-d8aeaf454ce3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:23.544643 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-12ef1287-b4bd-4abb-89d7-d8aeaf454ce3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:23.552604 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-12ef1287-b4bd-4abb-89d7-d8aeaf454ce3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1359 microversion: 2.1 time: 0.148569 Aug 01 14:25:23.553174 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 368/723] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:23 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:24.075326 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f5eed038-83d8-4012-9815-5ce7ac867cd3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:24.075948 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f5eed038-83d8-4012-9815-5ce7ac867cd3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:24.082384 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f5eed038-83d8-4012-9815-5ce7ac867cd3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:24.082829 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f5eed038-83d8-4012-9815-5ce7ac867cd3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:24.083626 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f5eed038-83d8-4012-9815-5ce7ac867cd3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:24.084060 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f5eed038-83d8-4012-9815-5ce7ac867cd3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:24.212364 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f5eed038-83d8-4012-9815-5ce7ac867cd3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:24.220906 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f5eed038-83d8-4012-9815-5ce7ac867cd3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1735 microversion: 2.1 time: 0.149503 Aug 01 14:25:24.221464 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 356/724] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:24 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:24.574063 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a8e3957c-3f24-47eb-a5a5-4e838f928059 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:24.574672 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a8e3957c-3f24-47eb-a5a5-4e838f928059 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:24.581863 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a8e3957c-3f24-47eb-a5a5-4e838f928059 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:24.582331 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a8e3957c-3f24-47eb-a5a5-4e838f928059 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:24.583072 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a8e3957c-3f24-47eb-a5a5-4e838f928059 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:24.583534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a8e3957c-3f24-47eb-a5a5-4e838f928059 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:24.716674 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a8e3957c-3f24-47eb-a5a5-4e838f928059 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:24.724390 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a8e3957c-3f24-47eb-a5a5-4e838f928059 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1359 microversion: 2.1 time: 0.154099 Aug 01 14:25:24.724892 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 369/725] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:24 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:25.242662 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-02bdaacb-6fa1-48b1-acaa-60afe98b75d5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:25.243207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-02bdaacb-6fa1-48b1-acaa-60afe98b75d5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:25.250424 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-02bdaacb-6fa1-48b1-acaa-60afe98b75d5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:25.250871 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-02bdaacb-6fa1-48b1-acaa-60afe98b75d5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:25.251669 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-02bdaacb-6fa1-48b1-acaa-60afe98b75d5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:25.252110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-02bdaacb-6fa1-48b1-acaa-60afe98b75d5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:25.387897 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-02bdaacb-6fa1-48b1-acaa-60afe98b75d5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:25.397444 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-02bdaacb-6fa1-48b1-acaa-60afe98b75d5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1735 microversion: 2.1 time: 0.158760 Aug 01 14:25:25.398047 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 357/726] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:25 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:25.745016 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a58375c5-04db-4967-8140-885086925909 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:25.745622 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a58375c5-04db-4967-8140-885086925909 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:25.752143 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a58375c5-04db-4967-8140-885086925909 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:25.752597 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a58375c5-04db-4967-8140-885086925909 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:25.753351 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a58375c5-04db-4967-8140-885086925909 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:25.753783 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a58375c5-04db-4967-8140-885086925909 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:25.890073 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a58375c5-04db-4967-8140-885086925909 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:25.897400 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a58375c5-04db-4967-8140-885086925909 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1359 microversion: 2.1 time: 0.156320 Aug 01 14:25:25.897958 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 370/727] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:25 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:26.418505 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d5f15917-6d17-4038-81dd-82b025554b53 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:26.419142 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d5f15917-6d17-4038-81dd-82b025554b53 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:26.425957 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d5f15917-6d17-4038-81dd-82b025554b53 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:26.426406 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d5f15917-6d17-4038-81dd-82b025554b53 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:26.427174 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d5f15917-6d17-4038-81dd-82b025554b53 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:26.427653 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d5f15917-6d17-4038-81dd-82b025554b53 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:26.556584 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d5f15917-6d17-4038-81dd-82b025554b53 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:26.565037 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d5f15917-6d17-4038-81dd-82b025554b53 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1735 microversion: 2.1 time: 0.150443 Aug 01 14:25:26.565634 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 358/728] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:26 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:26.918461 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-87618282-e1bd-402c-bb9d-4032279482c4 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:26.919038 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-87618282-e1bd-402c-bb9d-4032279482c4 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:26.926393 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-87618282-e1bd-402c-bb9d-4032279482c4 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:26.926844 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-87618282-e1bd-402c-bb9d-4032279482c4 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:26.927697 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-87618282-e1bd-402c-bb9d-4032279482c4 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:26.928137 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-87618282-e1bd-402c-bb9d-4032279482c4 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:27.061524 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-87618282-e1bd-402c-bb9d-4032279482c4 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:27.070038 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-87618282-e1bd-402c-bb9d-4032279482c4 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1359 microversion: 2.1 time: 0.155679 Aug 01 14:25:27.070613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 371/729] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:26 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:27.586220 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9a9a6c05-b73d-4ce1-aa96-a2d7f673d57e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:27.586822 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9a9a6c05-b73d-4ce1-aa96-a2d7f673d57e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:27.594015 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9a9a6c05-b73d-4ce1-aa96-a2d7f673d57e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:27.594720 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9a9a6c05-b73d-4ce1-aa96-a2d7f673d57e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:27.595531 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9a9a6c05-b73d-4ce1-aa96-a2d7f673d57e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:27.595977 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9a9a6c05-b73d-4ce1-aa96-a2d7f673d57e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:27.727134 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9a9a6c05-b73d-4ce1-aa96-a2d7f673d57e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:27.735135 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9a9a6c05-b73d-4ce1-aa96-a2d7f673d57e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1735 microversion: 2.1 time: 0.152887 Aug 01 14:25:27.735732 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 359/730] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:27 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:27.991867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e650e956-778d-45ef-a587-d84783c3c634 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9afa2bd3-ad94-4ee2-8080-3f2d22998843"}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:27.994281 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e650e956-778d-45ef-a587-d84783c3c634 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:28.002412 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e650e956-778d-45ef-a587-d84783c3c634 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:28.002852 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e650e956-778d-45ef-a587-d84783c3c634 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:28.003634 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e650e956-778d-45ef-a587-d84783c3c634 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:28.004059 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e650e956-778d-45ef-a587-d84783c3c634 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:28.087707 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-e650e956-778d-45ef-a587-d84783c3c634 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] HTTP exception thrown: Invalid volume: volume 9afa2bd3-ad94-4ee2-8080-3f2d22998843 is already attached to instances: 4ca84836-fe43-46c9-9829-ed762608ad39 Aug 01 14:25:28.089471 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e650e956-778d-45ef-a587-d84783c3c634 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Request method failure captured: Aug 01 14:25:28.089471 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: request: POST /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39/os-volume_attachments HTTP/1.1 Aug 01 14:25:28.089471 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept: application/json Aug 01 14:25:28.089471 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Aug 01 14:25:28.089471 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Connection: close Aug 01 14:25:28.089471 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Length: 74 Aug 01 14:25:28.089471 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Type: application/json Aug 01 14:25:28.089471 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Host: 10.222.0.17 Aug 01 14:25:28.089471 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Aug 01 14:25:28.089471 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.10 Aug 01 14:25:28.089471 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABi5-EkulQUZ9RnUqab4WEJwGiX-pJM7HxTgHalzWuk3LLo8fvk1GbjHf7oAdc4K40oSiRvHm3paXWQHzpNKMP3IF1Z4LwboIgWgWHXBlkSgdewDx_VoBUgWaMnbInPDU7YB5AlXhd0VLng73Y5VTtdj1967GURnhVKliVHkMShTgChU3Y Aug 01 14:25:28.089471 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Aug 01 14:25:28.089471 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Aug 01 14:25:28.089471 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Aug 01 14:25:28.089471 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Aug 01 14:25:28.089471 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Aug 01 14:25:28.089471 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Aug 01 14:25:28.089471 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Id: 3092982f3c6f4851a5a6e84bf7872d11 Aug 01 14:25:28.089471 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:25:28.089471 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Role: reader,member Aug 01 14:25:28.089471 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Roles: reader,member Aug 01 14:25:28.090788 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3092982f3c6f4851a5a6e84bf7872d11", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:25:28.090788 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:25:28.090788 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 3092982f3c6f4851a5a6e84bf7872d11 Aug 01 14:25:28.090788 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:25:28.090788 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User: tempest-AttachVolumeNegativeTest-134821563-project Aug 01 14:25:28.090788 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Aug 01 14:25:28.090788 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Aug 01 14:25:28.090788 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Id: 9eda4e19122444cf9cb2b6941adff9d5 Aug 01 14:25:28.090788 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-AttachVolumeNegativeTest-134821563-project Aug 01 14:25:28.090788 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Aug 01 14:25:28.090788 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {"volumeAttachment": {"volumeId": "9afa2bd3-ad94-4ee2-8080-3f2d22998843"}} Aug 01 14:25:28.090788 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: method: > Aug 01 14:25:28.091768 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: exception: Invalid volume: volume 9afa2bd3-ad94-4ee2-8080-3f2d22998843 is already attached to instances: 4ca84836-fe43-46c9-9829-ed762608ad39 Aug 01 14:25:28.091768 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: action_args: {'server_id': '4ca84836-fe43-46c9-9829-ed762608ad39', 'body': {'volumeAttachment': {'volumeId': '9afa2bd3-ad94-4ee2-8080-3f2d22998843'}}} Aug 01 14:25:28.091768 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:25:28.091768 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:25:28.091768 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 14:25:28.091768 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 14:25:28.091768 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 14:25:28.091768 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 14:25:28.091768 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 14:25:28.091768 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 14:25:28.091768 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 01 14:25:28.091768 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 01 14:25:28.091768 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 01 14:25:28.091768 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 01 14:25:28.091768 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9afa2bd3-ad94-4ee2-8080-3f2d22998843 is already attached to instances: 4ca84836-fe43-46c9-9829-ed762608ad39 Aug 01 14:25:28.091768 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:25:28.091768 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:25:28.091768 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:25:28.091768 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:25:28.093088 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:25:28.093088 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:25:28.093088 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:25:28.093088 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:25:28.093088 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:25:28.093088 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:25:28.093088 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:25:28.093088 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:25:28.093088 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:25:28.093088 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:25:28.093088 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:25:28.093088 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:25:28.093088 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 01 14:25:28.093088 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 14:25:28.093088 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9afa2bd3-ad94-4ee2-8080-3f2d22998843 is already attached to instances: 4ca84836-fe43-46c9-9829-ed762608ad39 Aug 01 14:25:28.093088 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:25:28.093088 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:25:28.093088 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:25:28.093088 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:25:28.093088 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:25:28.094251 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:25:28.094251 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:25:28.094251 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:25:28.094251 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9afa2bd3-ad94-4ee2-8080-3f2d22998843 is already attached to instances: 4ca84836-fe43-46c9-9829-ed762608ad39 Aug 01 14:25:28.094251 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:25:28.094251 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e650e956-778d-45ef-a587-d84783c3c634 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Returning 400 to user: Invalid volume: volume 9afa2bd3-ad94-4ee2-8080-3f2d22998843 is already attached to instances: 4ca84836-fe43-46c9-9829-ed762608ad39 {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:25:28.094919 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3e4b1213-5cb8-403b-85a2-ce63e7c040fa tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:28.095010 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e650e956-778d-45ef-a587-d84783c3c634 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "POST /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103119 Aug 01 14:25:28.095094 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3e4b1213-5cb8-403b-85a2-ce63e7c040fa tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:28.095169 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 372/731] 10.222.0.17 () {60 vars in 1323 bytes} [Mon Aug 1 14:25:27 2022] POST /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:25:28.102578 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e4b1213-5cb8-403b-85a2-ce63e7c040fa tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:28.103088 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e4b1213-5cb8-403b-85a2-ce63e7c040fa tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:28.104027 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e4b1213-5cb8-403b-85a2-ce63e7c040fa tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:28.104733 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e4b1213-5cb8-403b-85a2-ce63e7c040fa tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:28.125206 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:28.168534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-fa5e0920-aa18-4af1-84e5-d853b91ef91a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:28.169028 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-fa5e0920-aa18-4af1-84e5-d853b91ef91a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:28.175849 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fa5e0920-aa18-4af1-84e5-d853b91ef91a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:28.176319 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fa5e0920-aa18-4af1-84e5-d853b91ef91a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:28.177080 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fa5e0920-aa18-4af1-84e5-d853b91ef91a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:28.177514 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fa5e0920-aa18-4af1-84e5-d853b91ef91a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:28.256895 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3e4b1213-5cb8-403b-85a2-ce63e7c040fa tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:28.265180 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3e4b1213-5cb8-403b-85a2-ce63e7c040fa tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1359 microversion: 2.1 time: 0.178185 Aug 01 14:25:28.266283 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 360/732] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:28 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:28.269420 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-fa5e0920-aa18-4af1-84e5-d853b91ef91a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lazy-loading 'services' on Instance uuid 4ca84836-fe43-46c9-9829-ed762608ad39 {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:25:28.271813 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-971ba2e1-09f0-4813-be24-81612580c213 req-69b1f0f1-2b70-45a3-8cd0-bdb7e1d4b93a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75578a42-6025-4833-8349-dd37db5a195f", "name": "network-vif-plugged", "status": "completed", "tag": "e829424e-7724-42ac-b5c9-19446ad3fa09"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:28.282365 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-971ba2e1-09f0-4813-be24-81612580c213 req-69b1f0f1-2b70-45a3-8cd0-bdb7e1d4b93a service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:28.283781 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-971ba2e1-09f0-4813-be24-81612580c213 req-69b1f0f1-2b70-45a3-8cd0-bdb7e1d4b93a service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:28.297037 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-971ba2e1-09f0-4813-be24-81612580c213 req-69b1f0f1-2b70-45a3-8cd0-bdb7e1d4b93a service nova] Creating event network-vif-plugged:e829424e-7724-42ac-b5c9-19446ad3fa09 for instance 75578a42-6025-4833-8349-dd37db5a195f on hv-cinder-84599 Aug 01 14:25:28.302301 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-971ba2e1-09f0-4813-be24-81612580c213 req-69b1f0f1-2b70-45a3-8cd0-bdb7e1d4b93a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034719 Aug 01 14:25:28.302901 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 361/733] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:25:28.341413 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=100 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:28.353372 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-fa5e0920-aa18-4af1-84e5-d853b91ef91a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39/os-volume_attachments/9afa2bd3-ad94-4ee2-8080-3f2d22998843" status: 202 len: 0 microversion: 2.1 time: 0.188497 Aug 01 14:25:28.353988 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 373/734] 10.222.0.17 () {58 vars in 1416 bytes} [Mon Aug 1 14:25:28 2022] DELETE /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39/os-volume_attachments/9afa2bd3-ad94-4ee2-8080-3f2d22998843 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 14:25:28.364432 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-65cc402e-2a44-4dd8-b446-3a9e69a6c298 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:28.366890 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-65cc402e-2a44-4dd8-b446-3a9e69a6c298 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:28.373577 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-65cc402e-2a44-4dd8-b446-3a9e69a6c298 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:28.374644 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-65cc402e-2a44-4dd8-b446-3a9e69a6c298 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:28.375425 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-65cc402e-2a44-4dd8-b446-3a9e69a6c298 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:28.375835 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-65cc402e-2a44-4dd8-b446-3a9e69a6c298 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:28.408241 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-65cc402e-2a44-4dd8-b446-3a9e69a6c298 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048862 Aug 01 14:25:28.408717 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 362/735] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Aug 1 14:25:28 2022] GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:25:28.758697 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c12c8242-0124-4b5f-95a2-e6dcde9701e7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:28.759374 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c12c8242-0124-4b5f-95a2-e6dcde9701e7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:28.766675 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c12c8242-0124-4b5f-95a2-e6dcde9701e7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:28.767125 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c12c8242-0124-4b5f-95a2-e6dcde9701e7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:28.767947 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c12c8242-0124-4b5f-95a2-e6dcde9701e7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:28.768374 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c12c8242-0124-4b5f-95a2-e6dcde9701e7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:28.946985 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c12c8242-0124-4b5f-95a2-e6dcde9701e7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:28.955977 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c12c8242-0124-4b5f-95a2-e6dcde9701e7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1735 microversion: 2.1 time: 0.201574 Aug 01 14:25:28.957012 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 374/736] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:28 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1735 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:29.287298 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ad11cb90-f3ea-496e-a97b-49d2a93e7965 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:29.287938 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ad11cb90-f3ea-496e-a97b-49d2a93e7965 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:29.294440 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ad11cb90-f3ea-496e-a97b-49d2a93e7965 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:29.294886 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ad11cb90-f3ea-496e-a97b-49d2a93e7965 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:29.296345 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ad11cb90-f3ea-496e-a97b-49d2a93e7965 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:29.296783 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ad11cb90-f3ea-496e-a97b-49d2a93e7965 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:29.421573 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a74d094d-67e3-45cd-8520-c1980025f1e2 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:29.423983 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a74d094d-67e3-45cd-8520-c1980025f1e2 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:29.430686 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a74d094d-67e3-45cd-8520-c1980025f1e2 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:29.431164 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a74d094d-67e3-45cd-8520-c1980025f1e2 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:29.431638 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ad11cb90-f3ea-496e-a97b-49d2a93e7965 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:29.431973 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a74d094d-67e3-45cd-8520-c1980025f1e2 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:29.432404 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a74d094d-67e3-45cd-8520-c1980025f1e2 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:29.439336 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ad11cb90-f3ea-496e-a97b-49d2a93e7965 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1359 microversion: 2.1 time: 0.155873 Aug 01 14:25:29.439944 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 363/737] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:29 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:29.463442 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a74d094d-67e3-45cd-8520-c1980025f1e2 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046512 Aug 01 14:25:29.464033 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 375/738] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Aug 1 14:25:29 2022] GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:25:29.976675 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d20aa048-6dbb-402a-bf5c-bab86037abce tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:29.977194 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d20aa048-6dbb-402a-bf5c-bab86037abce tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:29.983234 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d20aa048-6dbb-402a-bf5c-bab86037abce tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:29.983719 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d20aa048-6dbb-402a-bf5c-bab86037abce tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:29.984479 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d20aa048-6dbb-402a-bf5c-bab86037abce tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:29.985104 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d20aa048-6dbb-402a-bf5c-bab86037abce tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:30.122070 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d20aa048-6dbb-402a-bf5c-bab86037abce tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:30.130876 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d20aa048-6dbb-402a-bf5c-bab86037abce tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1735 microversion: 2.1 time: 0.158081 Aug 01 14:25:30.131418 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 364/739] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:29 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:30.460306 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2b91a2e9-4330-403b-990a-0e1cc5b92046 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:30.460899 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2b91a2e9-4330-403b-990a-0e1cc5b92046 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:30.467873 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2b91a2e9-4330-403b-990a-0e1cc5b92046 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:30.468310 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2b91a2e9-4330-403b-990a-0e1cc5b92046 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:30.469055 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2b91a2e9-4330-403b-990a-0e1cc5b92046 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:30.469790 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2b91a2e9-4330-403b-990a-0e1cc5b92046 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:30.476379 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7915edfa-75aa-495e-887c-dc9f63fd2385 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:30.478654 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7915edfa-75aa-495e-887c-dc9f63fd2385 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:30.485739 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7915edfa-75aa-495e-887c-dc9f63fd2385 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:30.486182 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7915edfa-75aa-495e-887c-dc9f63fd2385 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:30.486958 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7915edfa-75aa-495e-887c-dc9f63fd2385 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:30.487392 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7915edfa-75aa-495e-887c-dc9f63fd2385 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:30.517340 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7915edfa-75aa-495e-887c-dc9f63fd2385 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044839 Aug 01 14:25:30.518086 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 365/740] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Aug 1 14:25:30 2022] GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 01 14:25:30.581698 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-81f80bab-b6fc-4fb6-89ef-614fc942e479 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:30.582286 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-81f80bab-b6fc-4fb6-89ef-614fc942e479 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:30.588539 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-81f80bab-b6fc-4fb6-89ef-614fc942e479 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:30.589155 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-81f80bab-b6fc-4fb6-89ef-614fc942e479 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:30.589931 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-81f80bab-b6fc-4fb6-89ef-614fc942e479 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:30.590374 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-81f80bab-b6fc-4fb6-89ef-614fc942e479 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:30.606210 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-2b91a2e9-4330-403b-990a-0e1cc5b92046 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:30.614227 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2b91a2e9-4330-403b-990a-0e1cc5b92046 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1359 microversion: 2.1 time: 0.157744 Aug 01 14:25:30.614878 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 376/741] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:30 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:30.616232 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-81f80bab-b6fc-4fb6-89ef-614fc942e479 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] Going to try to terminate instance {{(pid=118133) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:25:30.704258 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-81f80bab-b6fc-4fb6-89ef-614fc942e479 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39" status: 204 len: 0 microversion: 2.1 time: 0.126262 Aug 01 14:25:30.705849 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 366/742] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Aug 1 14:25:30 2022] DELETE /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 14:25:30.714206 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-514cd6e8-edab-48e4-ae60-95e4cefcddba tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:30.714749 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-514cd6e8-edab-48e4-ae60-95e4cefcddba tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:30.721818 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-514cd6e8-edab-48e4-ae60-95e4cefcddba tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:30.722267 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-514cd6e8-edab-48e4-ae60-95e4cefcddba tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:30.723036 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-514cd6e8-edab-48e4-ae60-95e4cefcddba tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:30.723490 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-514cd6e8-edab-48e4-ae60-95e4cefcddba tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:30.856591 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-514cd6e8-edab-48e4-ae60-95e4cefcddba tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:30.865038 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-514cd6e8-edab-48e4-ae60-95e4cefcddba tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39" status: 200 len: 1679 microversion: 2.1 time: 0.154817 Aug 01 14:25:30.865617 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 377/743] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:30 2022] GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:31.153949 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f1f72ef9-8adb-4368-abd8-64827641a39c tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:31.154858 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f1f72ef9-8adb-4368-abd8-64827641a39c tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:31.163484 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f1f72ef9-8adb-4368-abd8-64827641a39c tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:31.164242 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f1f72ef9-8adb-4368-abd8-64827641a39c tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:31.165032 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f1f72ef9-8adb-4368-abd8-64827641a39c tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:31.165792 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f1f72ef9-8adb-4368-abd8-64827641a39c tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:31.298781 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f1f72ef9-8adb-4368-abd8-64827641a39c tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:31.306735 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f1f72ef9-8adb-4368-abd8-64827641a39c tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1735 microversion: 2.1 time: 0.157820 Aug 01 14:25:31.307299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 367/744] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:31 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:31.694813 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-42de1cf3-4df8-400f-8213-6e1d7cd8c257 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:31.695406 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-42de1cf3-4df8-400f-8213-6e1d7cd8c257 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:31.702459 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-42de1cf3-4df8-400f-8213-6e1d7cd8c257 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:31.702902 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-42de1cf3-4df8-400f-8213-6e1d7cd8c257 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:31.703707 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-42de1cf3-4df8-400f-8213-6e1d7cd8c257 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:31.704118 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-42de1cf3-4df8-400f-8213-6e1d7cd8c257 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:31.835849 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-42de1cf3-4df8-400f-8213-6e1d7cd8c257 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:31.843228 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-42de1cf3-4df8-400f-8213-6e1d7cd8c257 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1549 microversion: 2.1 time: 0.152253 Aug 01 14:25:31.843834 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 378/745] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:31 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:31.863917 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a748f460-d2a5-4d31-9767-b3ee314ab5f0 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:31.864526 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a748f460-d2a5-4d31-9767-b3ee314ab5f0 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:31.871002 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a748f460-d2a5-4d31-9767-b3ee314ab5f0 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:31.871469 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a748f460-d2a5-4d31-9767-b3ee314ab5f0 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:31.872250 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a748f460-d2a5-4d31-9767-b3ee314ab5f0 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:31.872684 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a748f460-d2a5-4d31-9767-b3ee314ab5f0 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:31.888450 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1ce2aeb5-1b11-40c8-afcb-4dad7b6ed8f3 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:31.889097 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-1ce2aeb5-1b11-40c8-afcb-4dad7b6ed8f3 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:31.894969 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1ce2aeb5-1b11-40c8-afcb-4dad7b6ed8f3 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:31.895411 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1ce2aeb5-1b11-40c8-afcb-4dad7b6ed8f3 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:31.896196 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1ce2aeb5-1b11-40c8-afcb-4dad7b6ed8f3 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:31.896627 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1ce2aeb5-1b11-40c8-afcb-4dad7b6ed8f3 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:32.007183 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a748f460-d2a5-4d31-9767-b3ee314ab5f0 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:32.014803 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a748f460-d2a5-4d31-9767-b3ee314ab5f0 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1549 microversion: 2.1 time: 0.154739 Aug 01 14:25:32.015380 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 368/746] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:31 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:32.037364 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1ce2aeb5-1b11-40c8-afcb-4dad7b6ed8f3 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:32.045408 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d50e1872-c040-4a5c-8404-6201e695a2a1 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:32.046225 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-1ce2aeb5-1b11-40c8-afcb-4dad7b6ed8f3 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39" status: 200 len: 1679 microversion: 2.1 time: 0.160893 Aug 01 14:25:32.046812 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 379/747] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:31 2022] GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:25:32.050644 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d50e1872-c040-4a5c-8404-6201e695a2a1 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:32.051409 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d50e1872-c040-4a5c-8404-6201e695a2a1 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Searching by: {'deleted': False, 'project_id': '83c251299d274471b80df4ff026b0102'} {{(pid=118133) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 01 14:25:32.058164 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d50e1872-c040-4a5c-8404-6201e695a2a1 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:32.058607 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d50e1872-c040-4a5c-8404-6201e695a2a1 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:32.059418 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d50e1872-c040-4a5c-8404-6201e695a2a1 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:32.059884 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d50e1872-c040-4a5c-8404-6201e695a2a1 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:32.151171 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.multi_cell_list [None req-d50e1872-c040-4a5c-8404-6201e695a2a1 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118133) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 01 14:25:32.244879 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d50e1872-c040-4a5c-8404-6201e695a2a1 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.205183 Aug 01 14:25:32.245463 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 369/748] 10.222.0.17 () {58 vars in 1125 bytes} [Mon Aug 1 14:25:32 2022] GET /compute/v2.1/servers => generated 343 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:25:32.256870 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4ea1e543-3c91-427e-a515-c16896e96cf3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:32.257471 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4ea1e543-3c91-427e-a515-c16896e96cf3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:32.263630 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ea1e543-3c91-427e-a515-c16896e96cf3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:32.264091 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ea1e543-3c91-427e-a515-c16896e96cf3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:32.265244 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ea1e543-3c91-427e-a515-c16896e96cf3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:32.265717 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4ea1e543-3c91-427e-a515-c16896e96cf3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:32.328390 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6cf19c49-b18e-4a9e-92ed-ede82fc4c035 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:32.328895 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-6cf19c49-b18e-4a9e-92ed-ede82fc4c035 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:32.335022 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6cf19c49-b18e-4a9e-92ed-ede82fc4c035 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:32.335664 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6cf19c49-b18e-4a9e-92ed-ede82fc4c035 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:32.336663 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6cf19c49-b18e-4a9e-92ed-ede82fc4c035 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:32.337101 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6cf19c49-b18e-4a9e-92ed-ede82fc4c035 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:32.407765 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4ea1e543-3c91-427e-a515-c16896e96cf3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:32.415501 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4ea1e543-3c91-427e-a515-c16896e96cf3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1549 microversion: 2.1 time: 0.162652 Aug 01 14:25:32.416086 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 380/749] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:32 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:32.478032 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6cf19c49-b18e-4a9e-92ed-ede82fc4c035 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:32.486241 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6cf19c49-b18e-4a9e-92ed-ede82fc4c035 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1735 microversion: 2.1 time: 0.162222 Aug 01 14:25:32.487125 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 370/750] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:32 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:25:33.068130 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-146edd9f-1c58-4101-abde-ad9b3b55c4f9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:33.068729 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-146edd9f-1c58-4101-abde-ad9b3b55c4f9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:33.075336 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-146edd9f-1c58-4101-abde-ad9b3b55c4f9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:33.075820 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-146edd9f-1c58-4101-abde-ad9b3b55c4f9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:33.076590 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-146edd9f-1c58-4101-abde-ad9b3b55c4f9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:33.077022 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-146edd9f-1c58-4101-abde-ad9b3b55c4f9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:33.294028 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-146edd9f-1c58-4101-abde-ad9b3b55c4f9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:33.301760 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-146edd9f-1c58-4101-abde-ad9b3b55c4f9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39" status: 200 len: 1679 microversion: 2.1 time: 0.237455 Aug 01 14:25:33.302354 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 381/751] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:33 2022] GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39 => generated 1679 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:33.507894 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-081235a5-f5a5-437e-8801-99287dd4034e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:33.508767 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-081235a5-f5a5-437e-8801-99287dd4034e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:33.515698 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-081235a5-f5a5-437e-8801-99287dd4034e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:33.516154 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-081235a5-f5a5-437e-8801-99287dd4034e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:33.516927 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-081235a5-f5a5-437e-8801-99287dd4034e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:33.517557 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-081235a5-f5a5-437e-8801-99287dd4034e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:33.561809 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-962f6780-317d-483e-9779-541c15b2bd42 req-3e85e6f2-54af-48e5-82f6-a7a850eb6ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ca84836-fe43-46c9-9829-ed762608ad39", "name": "network-vif-deleted", "tag": "c9494ca7-e397-46ff-826b-71a8075c3785"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:33.574558 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-962f6780-317d-483e-9779-541c15b2bd42 req-3e85e6f2-54af-48e5-82f6-a7a850eb6ae7 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:33.575291 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-962f6780-317d-483e-9779-541c15b2bd42 req-3e85e6f2-54af-48e5-82f6-a7a850eb6ae7 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:33.610482 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-962f6780-317d-483e-9779-541c15b2bd42 req-3e85e6f2-54af-48e5-82f6-a7a850eb6ae7 service nova] Creating event network-vif-deleted:c9494ca7-e397-46ff-826b-71a8075c3785 for instance 4ca84836-fe43-46c9-9829-ed762608ad39 on hv-cinder-84599 Aug 01 14:25:33.625913 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-962f6780-317d-483e-9779-541c15b2bd42 req-3e85e6f2-54af-48e5-82f6-a7a850eb6ae7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065036 Aug 01 14:25:33.628553 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 382/752] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:25:33.701178 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-081235a5-f5a5-437e-8801-99287dd4034e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:33.711124 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-081235a5-f5a5-437e-8801-99287dd4034e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1735 microversion: 2.1 time: 0.207029 Aug 01 14:25:33.726824 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 371/753] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:33 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1735 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:34.020803 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4e33efaa-5b98-4727-a48e-afedf228aafa tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0db0512e-14bf-46bf-b04d-5b78f99bc212"}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:34.023648 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4e33efaa-5b98-4727-a48e-afedf228aafa tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:34.029751 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4e33efaa-5b98-4727-a48e-afedf228aafa tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:34.030203 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4e33efaa-5b98-4727-a48e-afedf228aafa tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:34.031036 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4e33efaa-5b98-4727-a48e-afedf228aafa tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:34.031855 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4e33efaa-5b98-4727-a48e-afedf228aafa tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:34.323008 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3e9127d7-b03f-4d5b-af52-582245150a8a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:34.323646 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3e9127d7-b03f-4d5b-af52-582245150a8a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:34.330025 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e9127d7-b03f-4d5b-af52-582245150a8a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:34.330466 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e9127d7-b03f-4d5b-af52-582245150a8a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:34.331235 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e9127d7-b03f-4d5b-af52-582245150a8a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:34.331696 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e9127d7-b03f-4d5b-af52-582245150a8a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:34.363057 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e9127d7-b03f-4d5b-af52-582245150a8a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:34.363513 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e9127d7-b03f-4d5b-af52-582245150a8a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:34.363960 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-3e9127d7-b03f-4d5b-af52-582245150a8a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lazy-loading 'fault' on Instance uuid 4ca84836-fe43-46c9-9829-ed762608ad39 {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:25:34.411319 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3e9127d7-b03f-4d5b-af52-582245150a8a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:34.422428 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3e9127d7-b03f-4d5b-af52-582245150a8a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39" status: 200 len: 1329 microversion: 2.1 time: 0.102512 Aug 01 14:25:34.423039 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 372/754] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:34 2022] GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39 => generated 1329 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:25:34.598590 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4e33efaa-5b98-4727-a48e-afedf228aafa tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "POST /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.581987 Aug 01 14:25:34.599502 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 383/755] 10.222.0.17 () {60 vars in 1323 bytes} [Mon Aug 1 14:25:34 2022] POST /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f/os-volume_attachments => generated 194 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:25:34.733316 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8c3ced7e-1254-472c-8e96-c3586e28ef70 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:34.734629 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8c3ced7e-1254-472c-8e96-c3586e28ef70 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:34.741366 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8c3ced7e-1254-472c-8e96-c3586e28ef70 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:34.741810 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8c3ced7e-1254-472c-8e96-c3586e28ef70 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:34.742574 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8c3ced7e-1254-472c-8e96-c3586e28ef70 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:34.743007 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8c3ced7e-1254-472c-8e96-c3586e28ef70 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:34.879552 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8c3ced7e-1254-472c-8e96-c3586e28ef70 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:34.887416 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8c3ced7e-1254-472c-8e96-c3586e28ef70 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1735 microversion: 2.1 time: 0.158064 Aug 01 14:25:34.887996 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 373/756] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:34 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:35.445703 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4c98792c-ba1e-4c9e-bc32-d32ca4a0d76b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:35.446391 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4c98792c-ba1e-4c9e-bc32-d32ca4a0d76b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:35.452823 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4c98792c-ba1e-4c9e-bc32-d32ca4a0d76b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:35.453279 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4c98792c-ba1e-4c9e-bc32-d32ca4a0d76b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:35.454113 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4c98792c-ba1e-4c9e-bc32-d32ca4a0d76b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:35.454608 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4c98792c-ba1e-4c9e-bc32-d32ca4a0d76b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:35.467861 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-4c98792c-ba1e-4c9e-bc32-d32ca4a0d76b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] HTTP exception thrown: Instance 4ca84836-fe43-46c9-9829-ed762608ad39 could not be found. Aug 01 14:25:35.470279 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4c98792c-ba1e-4c9e-bc32-d32ca4a0d76b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Request method failure captured: Aug 01 14:25:35.470279 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39 HTTP/1.1 Aug 01 14:25:35.470279 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept: application/json Aug 01 14:25:35.470279 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Aug 01 14:25:35.470279 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Connection: close Aug 01 14:25:35.470279 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Length: 0 Aug 01 14:25:35.470279 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Type: application/json Aug 01 14:25:35.470279 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Host: 10.222.0.17 Aug 01 14:25:35.470279 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Aug 01 14:25:35.470279 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.10 Aug 01 14:25:35.470279 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABi5-EkulQUZ9RnUqab4WEJwGiX-pJM7HxTgHalzWuk3LLo8fvk1GbjHf7oAdc4K40oSiRvHm3paXWQHzpNKMP3IF1Z4LwboIgWgWHXBlkSgdewDx_VoBUgWaMnbInPDU7YB5AlXhd0VLng73Y5VTtdj1967GURnhVKliVHkMShTgChU3Y Aug 01 14:25:35.470279 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Aug 01 14:25:35.470279 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Aug 01 14:25:35.470279 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Aug 01 14:25:35.470279 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Aug 01 14:25:35.470279 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Aug 01 14:25:35.470279 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Aug 01 14:25:35.470279 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Id: 3092982f3c6f4851a5a6e84bf7872d11 Aug 01 14:25:35.470279 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:25:35.470279 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Role: reader,member Aug 01 14:25:35.470279 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Roles: reader,member Aug 01 14:25:35.471825 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3092982f3c6f4851a5a6e84bf7872d11", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:25:35.471825 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:25:35.471825 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 3092982f3c6f4851a5a6e84bf7872d11 Aug 01 14:25:35.471825 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:25:35.471825 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User: tempest-AttachVolumeNegativeTest-134821563-project Aug 01 14:25:35.471825 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Aug 01 14:25:35.471825 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Aug 01 14:25:35.471825 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Id: 9eda4e19122444cf9cb2b6941adff9d5 Aug 01 14:25:35.471825 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-AttachVolumeNegativeTest-134821563-project Aug 01 14:25:35.471825 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: method: > Aug 01 14:25:35.471825 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: exception: Instance 4ca84836-fe43-46c9-9829-ed762608ad39 could not be found. Aug 01 14:25:35.471825 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: action_args: {'id': '4ca84836-fe43-46c9-9829-ed762608ad39'} Aug 01 14:25:35.472705 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:25:35.472705 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:25:35.472705 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:25:35.472705 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:25:35.472705 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:25:35.472705 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:25:35.472705 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:25:35.472705 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:25:35.472705 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:25:35.472705 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:25:35.472705 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ca84836-fe43-46c9-9829-ed762608ad39 could not be found. Aug 01 14:25:35.472705 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:25:35.472705 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:25:35.472705 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:25:35.472705 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:25:35.472705 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:25:35.472705 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:25:35.472705 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:25:35.472705 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:25:35.472705 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:25:35.474067 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:25:35.474067 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:25:35.474067 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:25:35.474067 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:25:35.474067 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:25:35.474067 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:25:35.474067 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:25:35.474067 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ca84836-fe43-46c9-9829-ed762608ad39 could not be found. Aug 01 14:25:35.474067 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:25:35.474067 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:25:35.474067 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:25:35.474067 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:25:35.474067 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:25:35.474067 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:25:35.474067 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:25:35.474067 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:25:35.474067 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ca84836-fe43-46c9-9829-ed762608ad39 could not be found. Aug 01 14:25:35.474067 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:25:35.475471 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4c98792c-ba1e-4c9e-bc32-d32ca4a0d76b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Returning 404 to user: Instance 4ca84836-fe43-46c9-9829-ed762608ad39 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:25:35.475471 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4c98792c-ba1e-4c9e-bc32-d32ca4a0d76b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39" status: 404 len: 111 microversion: 2.1 time: 0.031043 Aug 01 14:25:35.475471 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 384/757] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:35 2022] GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:25:35.481181 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-878d8fb7-bdac-4639-b7ad-2d51d1af8e71 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '.version_select at 0x7f6185dbc1f0>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:35.502014 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-878d8fb7-bdac-4639-b7ad-2d51d1af8e71 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-48999490" status: 202 len: 0 microversion: 2.1 time: 0.023416 Aug 01 14:25:35.502608 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 374/758] 10.222.0.17 () {58 vars in 1215 bytes} [Mon Aug 1 14:25:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-48999490 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:25:35.909439 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b60318b6-4423-4257-94cd-2b2a1bcbf190 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:35.910050 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b60318b6-4423-4257-94cd-2b2a1bcbf190 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:35.916589 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b60318b6-4423-4257-94cd-2b2a1bcbf190 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:35.917036 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b60318b6-4423-4257-94cd-2b2a1bcbf190 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:35.917805 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b60318b6-4423-4257-94cd-2b2a1bcbf190 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:35.918244 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b60318b6-4423-4257-94cd-2b2a1bcbf190 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:36.116175 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b60318b6-4423-4257-94cd-2b2a1bcbf190 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:36.124786 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b60318b6-4423-4257-94cd-2b2a1bcbf190 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1715 microversion: 2.1 time: 0.219280 Aug 01 14:25:36.125484 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 385/759] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:35 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1715 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:36.227758 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b444deb8-0ccc-4a55-995f-423efc6439e0 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Action: 'create', calling method: .version_select at 0x7f6189cbd820>, body: {"keypair": {"name": "tempest-keypair-1969136061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGi9QSvD1u/hadnfTZTBh2SplY53Pk55z5ZZh2srYaukK50pg4X6WfBjSh/se/QlovNtPwLNcUta/GU+LSEH2KDjp/OBotsFRV9FsZoE/G1lVEDlkj+Fw7b3y7mn+h77Ow=="}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:36.245034 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-b444deb8-0ccc-4a55-995f-423efc6439e0 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Getting quotas for project 3092982f3c6f4851a5a6e84bf7872d11. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:25:36.247411 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-763f2708-22ab-4d6e-aac7-cacf4fa77bf1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:36.247884 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-763f2708-22ab-4d6e-aac7-cacf4fa77bf1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:36.248917 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-b444deb8-0ccc-4a55-995f-423efc6439e0 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Getting quotas for user 9eda4e19122444cf9cb2b6941adff9d5 and project 3092982f3c6f4851a5a6e84bf7872d11. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:25:36.254206 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-763f2708-22ab-4d6e-aac7-cacf4fa77bf1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:36.254653 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-763f2708-22ab-4d6e-aac7-cacf4fa77bf1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:36.255469 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-763f2708-22ab-4d6e-aac7-cacf4fa77bf1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:36.256248 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-763f2708-22ab-4d6e-aac7-cacf4fa77bf1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:36.273291 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b444deb8-0ccc-4a55-995f-423efc6439e0 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049900 Aug 01 14:25:36.274181 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 375/760] 10.222.0.17 () {60 vars in 1159 bytes} [Mon Aug 1 14:25:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:25:36.345949 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-763f2708-22ab-4d6e-aac7-cacf4fa77bf1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] HTTP exception thrown: Cannot 'detach_volume' instance 5664fd60-279c-4671-9a77-a5bc99baf7be while it is in vm_state rescued Aug 01 14:25:36.347657 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-763f2708-22ab-4d6e-aac7-cacf4fa77bf1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Request method failure captured: Aug 01 14:25:36.347657 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: request: DELETE /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be/os-volume_attachments/6360ecf5-f1af-47a6-ad3c-f62caf62274d HTTP/1.1 Aug 01 14:25:36.347657 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept: application/json Aug 01 14:25:36.347657 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Aug 01 14:25:36.347657 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Connection: close Aug 01 14:25:36.347657 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Length: 0 Aug 01 14:25:36.347657 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Type: application/json Aug 01 14:25:36.347657 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Host: 10.222.0.17 Aug 01 14:25:36.347657 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Aug 01 14:25:36.347657 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.10 Aug 01 14:25:36.347657 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABi5-F11vtUeswQDfyKUVNd6Q87sVfV5PCR7Xd2YFUfSTJWvW9H9BSU4X5lFb9W0uL4F8nItvzcQSbBv2rf9PJYyTBlLiQDJSVh8lDqem48k4DbhTBdctnFQI9X7sX_oT1CnuXpX_5VYrPdv-R-oZXqnj9WBTnSUyuTG5740iwyNCsCcJ0 Aug 01 14:25:36.347657 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Aug 01 14:25:36.347657 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Aug 01 14:25:36.347657 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Aug 01 14:25:36.347657 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Aug 01 14:25:36.347657 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Aug 01 14:25:36.347657 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Aug 01 14:25:36.347657 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Id: 7b6f2af7de6b4e888e702c78f655448a Aug 01 14:25:36.347657 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1825573094 Aug 01 14:25:36.347657 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Role: reader,member Aug 01 14:25:36.347657 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Roles: reader,member Aug 01 14:25:36.349238 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7b6f2af7de6b4e888e702c78f655448a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7b6f2af7de6b4e888e702c78f655448a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7b6f2af7de6b4e888e702c78f655448a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7b6f2af7de6b4e888e702c78f655448a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:25:36.349238 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1825573094 Aug 01 14:25:36.349238 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 7b6f2af7de6b4e888e702c78f655448a Aug 01 14:25:36.349238 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1825573094 Aug 01 14:25:36.349238 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User: tempest-ServerRescueNegativeTestJSON-1825573094-project Aug 01 14:25:36.349238 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Aug 01 14:25:36.349238 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Aug 01 14:25:36.349238 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Id: c487e443eb274090bce842e855b015ec Aug 01 14:25:36.349238 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1825573094-project Aug 01 14:25:36.349238 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: method: > Aug 01 14:25:36.349238 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: exception: Cannot 'detach_volume' instance 5664fd60-279c-4671-9a77-a5bc99baf7be while it is in vm_state rescued Aug 01 14:25:36.350026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: action_args: {'server_id': '5664fd60-279c-4671-9a77-a5bc99baf7be', 'id': '6360ecf5-f1af-47a6-ad3c-f62caf62274d'} Aug 01 14:25:36.350026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:25:36.350026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:25:36.350026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 01 14:25:36.350026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 01 14:25:36.350026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 14:25:36.350026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 14:25:36.350026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 01 14:25:36.350026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 01 14:25:36.350026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5664fd60-279c-4671-9a77-a5bc99baf7be in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 01 14:25:36.350026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:25:36.350026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:25:36.350026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:25:36.350026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:25:36.350026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:25:36.350026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:25:36.350026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:25:36.350026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:25:36.350026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:25:36.350026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:25:36.355189 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 01 14:25:36.355189 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 01 14:25:36.355189 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 01 14:25:36.355189 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 01 14:25:36.355189 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5664fd60-279c-4671-9a77-a5bc99baf7be while it is in vm_state rescued Aug 01 14:25:36.355189 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:25:36.355189 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:25:36.355189 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:25:36.355189 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:25:36.355189 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:25:36.355189 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:25:36.355189 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:25:36.355189 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:25:36.355189 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5664fd60-279c-4671-9a77-a5bc99baf7be while it is in vm_state rescued Aug 01 14:25:36.355189 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:25:36.355189 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-763f2708-22ab-4d6e-aac7-cacf4fa77bf1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Returning 409 to user: Cannot 'detach_volume' instance 5664fd60-279c-4671-9a77-a5bc99baf7be while it is in vm_state rescued {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:25:36.356958 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-763f2708-22ab-4d6e-aac7-cacf4fa77bf1 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be/os-volume_attachments/6360ecf5-f1af-47a6-ad3c-f62caf62274d" status: 409 len: 152 microversion: 2.1 time: 0.106233 Aug 01 14:25:36.356958 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 386/761] 10.222.0.17 () {58 vars in 1416 bytes} [Mon Aug 1 14:25:36 2022] DELETE /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be/os-volume_attachments/6360ecf5-f1af-47a6-ad3c-f62caf62274d => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 01 14:25:36.359857 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-acca9251-16be-4487-9bff-ffba3cbfca50 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:36.360402 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-acca9251-16be-4487-9bff-ffba3cbfca50 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:36.366720 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-acca9251-16be-4487-9bff-ffba3cbfca50 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:36.367175 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-acca9251-16be-4487-9bff-ffba3cbfca50 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:36.368005 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-acca9251-16be-4487-9bff-ffba3cbfca50 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:36.368448 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-acca9251-16be-4487-9bff-ffba3cbfca50 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:36.417408 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:36.439335 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-acca9251-16be-4487-9bff-ffba3cbfca50 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "POST /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be/action" status: 202 len: 0 microversion: 2.1 time: 0.084321 Aug 01 14:25:36.440215 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 376/762] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Aug 1 14:25:36 2022] POST /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 14:25:36.449323 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-63fda168-a7c0-464b-a0b1-d8e1a8b5a388 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:36.450035 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-63fda168-a7c0-464b-a0b1-d8e1a8b5a388 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:36.456838 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-63fda168-a7c0-464b-a0b1-d8e1a8b5a388 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:36.457124 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-63fda168-a7c0-464b-a0b1-d8e1a8b5a388 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:36.457893 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-63fda168-a7c0-464b-a0b1-d8e1a8b5a388 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:36.458331 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-63fda168-a7c0-464b-a0b1-d8e1a8b5a388 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:36.737510 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-63fda168-a7c0-464b-a0b1-d8e1a8b5a388 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:36.747593 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-63fda168-a7c0-464b-a0b1-d8e1a8b5a388 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1723 microversion: 2.1 time: 0.301948 Aug 01 14:25:36.760227 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 387/763] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:36 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1723 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:37.770580 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-1ca8750a-4fe6-42a6-90c5-c7439f8a3d7b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:37.771303 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1ca8750a-4fe6-42a6-90c5-c7439f8a3d7b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:37.778084 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1ca8750a-4fe6-42a6-90c5-c7439f8a3d7b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:37.778537 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1ca8750a-4fe6-42a6-90c5-c7439f8a3d7b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:37.779321 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1ca8750a-4fe6-42a6-90c5-c7439f8a3d7b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:37.779807 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1ca8750a-4fe6-42a6-90c5-c7439f8a3d7b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:37.935383 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1ca8750a-4fe6-42a6-90c5-c7439f8a3d7b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:37.943547 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-1ca8750a-4fe6-42a6-90c5-c7439f8a3d7b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1723 microversion: 2.1 time: 0.178419 Aug 01 14:25:37.944513 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 377/764] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:37 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:38.269328 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-075a6c53-f7fc-4577-ad83-bbb5ec71abe1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-132468127", "imageRef": "9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de859ae5-345c-4f53-adf9-d10ff3cac7a2"}], "security_groups": [{"name": "tempest-securitygroup--419202488"}], "key_name": "tempest-keypair-1969136061", "user_data": "}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:38.370797 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.network.neutron [None req-075a6c53-f7fc-4577-ad83-bbb5ec71abe1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] validate_networks() for [('de859ae5-345c-4f53-adf9-d10ff3cac7a2', None, None, None, None, None)] {{(pid=118132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:25:38.793315 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-075a6c53-f7fc-4577-ad83-bbb5ec71abe1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Flavor limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:25:38.793732 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-075a6c53-f7fc-4577-ad83-bbb5ec71abe1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Image limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:25:38.794196 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-075a6c53-f7fc-4577-ad83-bbb5ec71abe1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Flavor pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:25:38.794597 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-075a6c53-f7fc-4577-ad83-bbb5ec71abe1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Image pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:25:38.795000 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-075a6c53-f7fc-4577-ad83-bbb5ec71abe1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:25:38.804425 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-075a6c53-f7fc-4577-ad83-bbb5ec71abe1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:38.804866 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-075a6c53-f7fc-4577-ad83-bbb5ec71abe1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:38.805658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-075a6c53-f7fc-4577-ad83-bbb5ec71abe1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:38.806088 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-075a6c53-f7fc-4577-ad83-bbb5ec71abe1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:38.822848 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-075a6c53-f7fc-4577-ad83-bbb5ec71abe1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Getting quotas for project 3092982f3c6f4851a5a6e84bf7872d11. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:25:38.826881 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-075a6c53-f7fc-4577-ad83-bbb5ec71abe1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Getting quotas for user 9eda4e19122444cf9cb2b6941adff9d5 and project 3092982f3c6f4851a5a6e84bf7872d11. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:25:38.837908 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-075a6c53-f7fc-4577-ad83-bbb5ec71abe1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Going to run 1 instances... {{(pid=118132) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:25:38.840286 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-075a6c53-f7fc-4577-ad83-bbb5ec71abe1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: be8904b8-7a85-4d46-9dce-64e3503eaccf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:25:38.887412 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-075a6c53-f7fc-4577-ad83-bbb5ec71abe1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.623235 Aug 01 14:25:38.888394 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 388/765] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Aug 1 14:25:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:25:38.899171 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-557fa02e-44d0-47f6-856a-0c0d4ac61bf7 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:38.899818 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-557fa02e-44d0-47f6-856a-0c0d4ac61bf7 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: be8904b8-7a85-4d46-9dce-64e3503eaccf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:38.962058 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-557fa02e-44d0-47f6-856a-0c0d4ac61bf7 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:38.966266 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0e478735-444b-44be-842c-82af9b2e7b56 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:38.966876 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0e478735-444b-44be-842c-82af9b2e7b56 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:38.970327 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-557fa02e-44d0-47f6-856a-0c0d4ac61bf7 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf" status: 200 len: 1241 microversion: 2.1 time: 0.074987 Aug 01 14:25:38.970902 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 378/766] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:38 2022] GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:38.978898 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e478735-444b-44be-842c-82af9b2e7b56 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:38.979352 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e478735-444b-44be-842c-82af9b2e7b56 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:38.980151 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e478735-444b-44be-842c-82af9b2e7b56 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:38.980581 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e478735-444b-44be-842c-82af9b2e7b56 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:39.129459 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0e478735-444b-44be-842c-82af9b2e7b56 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:39.137506 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0e478735-444b-44be-842c-82af9b2e7b56 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1723 microversion: 2.1 time: 0.175473 Aug 01 14:25:39.138076 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 389/767] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:38 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:25:39.992013 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f776f739-4ce3-4c36-a056-6d007ae148ec tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:39.992660 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f776f739-4ce3-4c36-a056-6d007ae148ec tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: be8904b8-7a85-4d46-9dce-64e3503eaccf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:40.000957 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f776f739-4ce3-4c36-a056-6d007ae148ec tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:40.001408 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f776f739-4ce3-4c36-a056-6d007ae148ec tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:40.002177 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f776f739-4ce3-4c36-a056-6d007ae148ec tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:40.002615 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f776f739-4ce3-4c36-a056-6d007ae148ec tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:40.065789 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f776f739-4ce3-4c36-a056-6d007ae148ec tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:40.073277 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f776f739-4ce3-4c36-a056-6d007ae148ec tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf" status: 200 len: 1293 microversion: 2.1 time: 0.086199 Aug 01 14:25:40.073845 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 379/768] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:39 2022] GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:40.159197 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-055b4ed1-7e2a-43d4-98ef-b1cbbdd3447b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:40.159837 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-055b4ed1-7e2a-43d4-98ef-b1cbbdd3447b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:40.166263 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-055b4ed1-7e2a-43d4-98ef-b1cbbdd3447b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:40.166702 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-055b4ed1-7e2a-43d4-98ef-b1cbbdd3447b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:40.167449 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-055b4ed1-7e2a-43d4-98ef-b1cbbdd3447b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:40.167901 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-055b4ed1-7e2a-43d4-98ef-b1cbbdd3447b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:40.297030 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-055b4ed1-7e2a-43d4-98ef-b1cbbdd3447b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:40.305105 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-055b4ed1-7e2a-43d4-98ef-b1cbbdd3447b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1729 microversion: 2.1 time: 0.150288 Aug 01 14:25:40.305752 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 390/769] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:40 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:40.327168 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7dcb34fe-75b2-4522-bf6a-d64acb7e32c6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:40.328208 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7dcb34fe-75b2-4522-bf6a-d64acb7e32c6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:40.334284 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7dcb34fe-75b2-4522-bf6a-d64acb7e32c6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:40.334740 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7dcb34fe-75b2-4522-bf6a-d64acb7e32c6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:40.335541 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7dcb34fe-75b2-4522-bf6a-d64acb7e32c6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:40.335984 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7dcb34fe-75b2-4522-bf6a-d64acb7e32c6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:40.428152 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7dcb34fe-75b2-4522-bf6a-d64acb7e32c6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105259 Aug 01 14:25:40.428740 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 380/770] 10.222.0.17 () {58 vars in 1275 bytes} [Mon Aug 1 14:25:40 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:25:41.097486 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8127b485-df43-44f4-9618-81df6b3cf475 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:41.098098 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-8127b485-df43-44f4-9618-81df6b3cf475 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: be8904b8-7a85-4d46-9dce-64e3503eaccf] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:41.105159 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8127b485-df43-44f4-9618-81df6b3cf475 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:41.105896 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8127b485-df43-44f4-9618-81df6b3cf475 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:41.106679 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8127b485-df43-44f4-9618-81df6b3cf475 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:41.107114 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8127b485-df43-44f4-9618-81df6b3cf475 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:41.110670 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:41.182240 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-8127b485-df43-44f4-9618-81df6b3cf475 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:41.190479 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8127b485-df43-44f4-9618-81df6b3cf475 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf" status: 200 len: 1299 microversion: 2.1 time: 0.098601 Aug 01 14:25:41.191063 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 391/771] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:41 2022] GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:41.661813 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-d8ed49b5-453d-4ba9-840b-aaa642de6a63 req-0cef2d53-ac60-4b60-bf18-c87f2f8324a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5664fd60-279c-4671-9a77-a5bc99baf7be", "tag": "2898c3ea-4ab0-4c5f-9813-8db5fcaa5a1d"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:41.676185 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-d8ed49b5-453d-4ba9-840b-aaa642de6a63 req-0cef2d53-ac60-4b60-bf18-c87f2f8324a4 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:41.680607 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-d8ed49b5-453d-4ba9-840b-aaa642de6a63 req-0cef2d53-ac60-4b60-bf18-c87f2f8324a4 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:41.740020 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-d8ed49b5-453d-4ba9-840b-aaa642de6a63 req-0cef2d53-ac60-4b60-bf18-c87f2f8324a4 service nova] Creating event network-changed:2898c3ea-4ab0-4c5f-9813-8db5fcaa5a1d for instance 5664fd60-279c-4671-9a77-a5bc99baf7be on hv-cinder-84599 Aug 01 14:25:41.746245 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-d8ed49b5-453d-4ba9-840b-aaa642de6a63 req-0cef2d53-ac60-4b60-bf18-c87f2f8324a4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104751 Aug 01 14:25:41.751175 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 381/772] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 01 14:25:42.214248 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-527dabcf-9881-4fe0-b38b-43655339918a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:42.216080 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-527dabcf-9881-4fe0-b38b-43655339918a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: be8904b8-7a85-4d46-9dce-64e3503eaccf] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:42.234399 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-527dabcf-9881-4fe0-b38b-43655339918a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:42.235242 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-527dabcf-9881-4fe0-b38b-43655339918a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:42.236333 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-527dabcf-9881-4fe0-b38b-43655339918a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:42.237537 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-527dabcf-9881-4fe0-b38b-43655339918a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:42.247606 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f500c13f-2867-422d-81dd-d8ef98f23d67 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:42.248300 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f500c13f-2867-422d-81dd-d8ef98f23d67 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:42.250839 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:42.260528 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f500c13f-2867-422d-81dd-d8ef98f23d67 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:42.261588 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f500c13f-2867-422d-81dd-d8ef98f23d67 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:42.263344 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f500c13f-2867-422d-81dd-d8ef98f23d67 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:42.263992 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f500c13f-2867-422d-81dd-d8ef98f23d67 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:42.432932 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f500c13f-2867-422d-81dd-d8ef98f23d67 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:42.441662 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f500c13f-2867-422d-81dd-d8ef98f23d67 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1595 microversion: 2.1 time: 0.198071 Aug 01 14:25:42.458735 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 382/773] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:42 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1595 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:25:42.601418 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-527dabcf-9881-4fe0-b38b-43655339918a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:42.613709 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-527dabcf-9881-4fe0-b38b-43655339918a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf" status: 200 len: 1366 microversion: 2.1 time: 0.404540 Aug 01 14:25:42.614847 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 392/774] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:42 2022] GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf => generated 1366 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:25:42.887079 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-1f638a67-cc4e-49f6-90ef-1d8244a957d0 req-3b4d8f2a-e5ea-4d85-be71-5d56653dfac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be8904b8-7a85-4d46-9dce-64e3503eaccf", "tag": "5c3eb081-f18c-4173-8f0c-a5499944600a"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:42.901865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-1f638a67-cc4e-49f6-90ef-1d8244a957d0 req-3b4d8f2a-e5ea-4d85-be71-5d56653dfac7 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:42.902280 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-1f638a67-cc4e-49f6-90ef-1d8244a957d0 req-3b4d8f2a-e5ea-4d85-be71-5d56653dfac7 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:42.917339 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-1f638a67-cc4e-49f6-90ef-1d8244a957d0 req-3b4d8f2a-e5ea-4d85-be71-5d56653dfac7 service nova] Creating event network-changed:5c3eb081-f18c-4173-8f0c-a5499944600a for instance be8904b8-7a85-4d46-9dce-64e3503eaccf on hv-cinder-84599 Aug 01 14:25:42.922212 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-1f638a67-cc4e-49f6-90ef-1d8244a957d0 req-3b4d8f2a-e5ea-4d85-be71-5d56653dfac7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127486 Aug 01 14:25:42.922966 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 383/775] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:25:43.634187 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7bf7c3cd-0523-4f17-8cec-9db4d8f09a75 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:43.634901 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7bf7c3cd-0523-4f17-8cec-9db4d8f09a75 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: be8904b8-7a85-4d46-9dce-64e3503eaccf] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:43.642830 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7bf7c3cd-0523-4f17-8cec-9db4d8f09a75 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:43.643602 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7bf7c3cd-0523-4f17-8cec-9db4d8f09a75 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:43.644435 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7bf7c3cd-0523-4f17-8cec-9db4d8f09a75 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:43.644814 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7bf7c3cd-0523-4f17-8cec-9db4d8f09a75 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:43.775110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-fd30742f-e44d-471a-91a1-7cffeab4b7ab req-a313407b-a558-48b9-9db3-55b8f4ae7dce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5664fd60-279c-4671-9a77-a5bc99baf7be", "tag": "2898c3ea-4ab0-4c5f-9813-8db5fcaa5a1d"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:43.785733 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-fd30742f-e44d-471a-91a1-7cffeab4b7ab req-a313407b-a558-48b9-9db3-55b8f4ae7dce service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:43.786290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-fd30742f-e44d-471a-91a1-7cffeab4b7ab req-a313407b-a558-48b9-9db3-55b8f4ae7dce service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:43.790580 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7bf7c3cd-0523-4f17-8cec-9db4d8f09a75 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:43.797697 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-fd30742f-e44d-471a-91a1-7cffeab4b7ab req-a313407b-a558-48b9-9db3-55b8f4ae7dce service nova] Creating event network-changed:2898c3ea-4ab0-4c5f-9813-8db5fcaa5a1d for instance 5664fd60-279c-4671-9a77-a5bc99baf7be on hv-cinder-84599 Aug 01 14:25:43.799525 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7bf7c3cd-0523-4f17-8cec-9db4d8f09a75 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf" status: 200 len: 1366 microversion: 2.1 time: 0.168923 Aug 01 14:25:43.803493 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 393/776] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:43 2022] GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:43.803650 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-fd30742f-e44d-471a-91a1-7cffeab4b7ab req-a313407b-a558-48b9-9db3-55b8f4ae7dce service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031790 Aug 01 14:25:43.803650 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 384/777] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:25:44.821889 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b10c4807-c97e-48c0-bd3b-3181001cb10e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:44.822861 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b10c4807-c97e-48c0-bd3b-3181001cb10e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: be8904b8-7a85-4d46-9dce-64e3503eaccf] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:44.825239 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:44.830301 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b10c4807-c97e-48c0-bd3b-3181001cb10e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:44.830740 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b10c4807-c97e-48c0-bd3b-3181001cb10e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:44.831555 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b10c4807-c97e-48c0-bd3b-3181001cb10e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:44.831979 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b10c4807-c97e-48c0-bd3b-3181001cb10e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:45.454627 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b10c4807-c97e-48c0-bd3b-3181001cb10e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:45.464030 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b10c4807-c97e-48c0-bd3b-3181001cb10e tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf" status: 200 len: 1366 microversion: 2.1 time: 0.646118 Aug 01 14:25:45.476429 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 394/778] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:44 2022] GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf => generated 1366 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:45.789247 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-73dc7a86-c428-4f99-be0d-b3319dc3fa70 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-89940070"}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:45.789919 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-73dc7a86-c428-4f99-be0d-b3319dc3fa70 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:45.792347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:45.799260 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-73dc7a86-c428-4f99-be0d-b3319dc3fa70 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:45.799733 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-73dc7a86-c428-4f99-be0d-b3319dc3fa70 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:45.800509 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-73dc7a86-c428-4f99-be0d-b3319dc3fa70 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:45.801035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-73dc7a86-c428-4f99-be0d-b3319dc3fa70 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:45.823372 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-7aa81ee8-ba1d-4698-9e7a-a1dcbb1fa8ef req-eb967f90-7b2b-4a5b-b55d-1815ac6a5957 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75578a42-6025-4833-8349-dd37db5a195f", "tag": "e829424e-7724-42ac-b5c9-19446ad3fa09"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:45.833697 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-7aa81ee8-ba1d-4698-9e7a-a1dcbb1fa8ef req-eb967f90-7b2b-4a5b-b55d-1815ac6a5957 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:45.834225 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-7aa81ee8-ba1d-4698-9e7a-a1dcbb1fa8ef req-eb967f90-7b2b-4a5b-b55d-1815ac6a5957 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:45.846804 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-7aa81ee8-ba1d-4698-9e7a-a1dcbb1fa8ef req-eb967f90-7b2b-4a5b-b55d-1815ac6a5957 service nova] Creating event network-changed:e829424e-7724-42ac-b5c9-19446ad3fa09 for instance 75578a42-6025-4833-8349-dd37db5a195f on hv-cinder-84599 Aug 01 14:25:45.852235 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-7aa81ee8-ba1d-4698-9e7a-a1dcbb1fa8ef req-eb967f90-7b2b-4a5b-b55d-1815ac6a5957 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032664 Aug 01 14:25:45.852816 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 395/779] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:25:45.938744 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.network.security_group_api [None req-73dc7a86-c428-4f99-be0d-b3319dc3fa70 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Adding security group 1dd2b8d0-cae6-4911-a02c-23ac2a0b795b to port e829424e-7724-42ac-b5c9-19446ad3fa09 Aug 01 14:25:46.287060 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-73dc7a86-c428-4f99-be0d-b3319dc3fa70 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "POST /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f/action" status: 202 len: 0 microversion: 2.1 time: 0.501951 Aug 01 14:25:46.291887 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 385/780] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Aug 1 14:25:45 2022] POST /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:25:46.297240 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b4d622a9-e7df-4f63-8cfb-5427270324bc tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:46.297961 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b4d622a9-e7df-4f63-8cfb-5427270324bc tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:46.305409 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b4d622a9-e7df-4f63-8cfb-5427270324bc tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:46.306216 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b4d622a9-e7df-4f63-8cfb-5427270324bc tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:46.307239 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b4d622a9-e7df-4f63-8cfb-5427270324bc tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:46.307936 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b4d622a9-e7df-4f63-8cfb-5427270324bc tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:46.487598 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-cef054d0-f352-4e0f-8880-93048b0607f6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:46.488318 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-cef054d0-f352-4e0f-8880-93048b0607f6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: be8904b8-7a85-4d46-9dce-64e3503eaccf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:46.496095 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cef054d0-f352-4e0f-8880-93048b0607f6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:46.496580 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cef054d0-f352-4e0f-8880-93048b0607f6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:46.497594 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cef054d0-f352-4e0f-8880-93048b0607f6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:46.498103 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cef054d0-f352-4e0f-8880-93048b0607f6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:46.558347 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b4d622a9-e7df-4f63-8cfb-5427270324bc tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:46.568655 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b4d622a9-e7df-4f63-8cfb-5427270324bc tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1640 microversion: 2.1 time: 0.275681 Aug 01 14:25:46.569508 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 396/781] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:46 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1640 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:25:46.640451 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-cef054d0-f352-4e0f-8880-93048b0607f6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:46.648628 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-cef054d0-f352-4e0f-8880-93048b0607f6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf" status: 200 len: 1366 microversion: 2.1 time: 0.165311 Aug 01 14:25:46.649200 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 386/782] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:46 2022] GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:47.670076 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4f7f661c-c5ca-41f4-8fc1-9f8a958caed9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:47.670839 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4f7f661c-c5ca-41f4-8fc1-9f8a958caed9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: be8904b8-7a85-4d46-9dce-64e3503eaccf] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:47.677498 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4f7f661c-c5ca-41f4-8fc1-9f8a958caed9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:47.677890 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4f7f661c-c5ca-41f4-8fc1-9f8a958caed9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:47.678654 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4f7f661c-c5ca-41f4-8fc1-9f8a958caed9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:47.679091 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4f7f661c-c5ca-41f4-8fc1-9f8a958caed9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:47.806958 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4f7f661c-c5ca-41f4-8fc1-9f8a958caed9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:47.814349 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4f7f661c-c5ca-41f4-8fc1-9f8a958caed9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf" status: 200 len: 1366 microversion: 2.1 time: 0.148149 Aug 01 14:25:47.814908 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 397/783] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:47 2022] GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:47.921169 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-dd728d6b-5e07-4363-87f7-58cdf986b183 req-d208c713-377e-4836-bc17-0eafe05c2423 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75578a42-6025-4833-8349-dd37db5a195f", "tag": "e829424e-7724-42ac-b5c9-19446ad3fa09"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:47.930549 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-dd728d6b-5e07-4363-87f7-58cdf986b183 req-d208c713-377e-4836-bc17-0eafe05c2423 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:47.930988 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-dd728d6b-5e07-4363-87f7-58cdf986b183 req-d208c713-377e-4836-bc17-0eafe05c2423 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:47.942242 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-dd728d6b-5e07-4363-87f7-58cdf986b183 req-d208c713-377e-4836-bc17-0eafe05c2423 service nova] Creating event network-changed:e829424e-7724-42ac-b5c9-19446ad3fa09 for instance 75578a42-6025-4833-8349-dd37db5a195f on hv-cinder-84599 Aug 01 14:25:47.946947 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-dd728d6b-5e07-4363-87f7-58cdf986b183 req-d208c713-377e-4836-bc17-0eafe05c2423 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084231 Aug 01 14:25:47.947548 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 387/784] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:25:48.364543 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-b0d13970-9537-4ebf-a826-f6ca67518624 req-78e02262-66e3-44f8-be92-532c5424258c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be8904b8-7a85-4d46-9dce-64e3503eaccf", "name": "network-vif-plugged", "status": "completed", "tag": "5c3eb081-f18c-4173-8f0c-a5499944600a"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:48.375766 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-b0d13970-9537-4ebf-a826-f6ca67518624 req-78e02262-66e3-44f8-be92-532c5424258c service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:48.376373 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-b0d13970-9537-4ebf-a826-f6ca67518624 req-78e02262-66e3-44f8-be92-532c5424258c service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:48.388229 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-b0d13970-9537-4ebf-a826-f6ca67518624 req-78e02262-66e3-44f8-be92-532c5424258c service nova] Creating event network-vif-plugged:5c3eb081-f18c-4173-8f0c-a5499944600a for instance be8904b8-7a85-4d46-9dce-64e3503eaccf on hv-cinder-84599 Aug 01 14:25:48.393889 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-b0d13970-9537-4ebf-a826-f6ca67518624 req-78e02262-66e3-44f8-be92-532c5424258c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033499 Aug 01 14:25:48.394681 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 398/785] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:25:48.835901 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a327ead7-7e9a-4f37-ad39-5cdac6f390e1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:48.836597 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a327ead7-7e9a-4f37-ad39-5cdac6f390e1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: be8904b8-7a85-4d46-9dce-64e3503eaccf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:48.842851 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a327ead7-7e9a-4f37-ad39-5cdac6f390e1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:48.843299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a327ead7-7e9a-4f37-ad39-5cdac6f390e1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:48.844088 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a327ead7-7e9a-4f37-ad39-5cdac6f390e1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:48.844789 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a327ead7-7e9a-4f37-ad39-5cdac6f390e1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:48.966975 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=6 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:48.975926 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a327ead7-7e9a-4f37-ad39-5cdac6f390e1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:48.983276 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a327ead7-7e9a-4f37-ad39-5cdac6f390e1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf" status: 200 len: 1366 microversion: 2.1 time: 0.151680 Aug 01 14:25:48.983875 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 388/786] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:48 2022] GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:50.005236 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-99798266-dfb6-4612-8207-89de2a2764a1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:50.005992 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-99798266-dfb6-4612-8207-89de2a2764a1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: be8904b8-7a85-4d46-9dce-64e3503eaccf] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:50.008351 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=2 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:50.009007 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=6 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:50.015972 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-99798266-dfb6-4612-8207-89de2a2764a1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:50.016417 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-99798266-dfb6-4612-8207-89de2a2764a1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:50.017177 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-99798266-dfb6-4612-8207-89de2a2764a1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:50.017607 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-99798266-dfb6-4612-8207-89de2a2764a1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:50.147007 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-99798266-dfb6-4612-8207-89de2a2764a1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:50.154811 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-99798266-dfb6-4612-8207-89de2a2764a1 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf" status: 200 len: 1555 microversion: 2.1 time: 0.153819 Aug 01 14:25:50.155966 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 399/787] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:49 2022] GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:50.175588 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-89be6499-7440-47a5-9071-ab7817cd671c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:50.176148 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-89be6499-7440-47a5-9071-ab7817cd671c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: be8904b8-7a85-4d46-9dce-64e3503eaccf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:50.184021 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-89be6499-7440-47a5-9071-ab7817cd671c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:50.184459 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-89be6499-7440-47a5-9071-ab7817cd671c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:50.185220 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-89be6499-7440-47a5-9071-ab7817cd671c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:50.185673 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-89be6499-7440-47a5-9071-ab7817cd671c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:50.266624 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-89be6499-7440-47a5-9071-ab7817cd671c tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094799 Aug 01 14:25:50.267386 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 389/788] 10.222.0.17 () {58 vars in 1275 bytes} [Mon Aug 1 14:25:50 2022] GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:25:51.446349 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-8ad7b03f-2978-4ffe-99ad-bcd0a082ac1b req-7983d984-03b7-467f-898d-eea7692cffd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be8904b8-7a85-4d46-9dce-64e3503eaccf", "tag": "5c3eb081-f18c-4173-8f0c-a5499944600a"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:51.456869 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-8ad7b03f-2978-4ffe-99ad-bcd0a082ac1b req-7983d984-03b7-467f-898d-eea7692cffd7 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:51.457309 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-8ad7b03f-2978-4ffe-99ad-bcd0a082ac1b req-7983d984-03b7-467f-898d-eea7692cffd7 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:51.468304 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-8ad7b03f-2978-4ffe-99ad-bcd0a082ac1b req-7983d984-03b7-467f-898d-eea7692cffd7 service nova] Creating event network-changed:5c3eb081-f18c-4173-8f0c-a5499944600a for instance be8904b8-7a85-4d46-9dce-64e3503eaccf on hv-cinder-84599 Aug 01 14:25:51.474024 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-8ad7b03f-2978-4ffe-99ad-bcd0a082ac1b req-7983d984-03b7-467f-898d-eea7692cffd7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031286 Aug 01 14:25:51.475530 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 400/789] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:25:52.352821 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-18b41a1a-3ff2-4f60-ab79-ca8f1dfac040 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:52.353361 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-18b41a1a-3ff2-4f60-ab79-ca8f1dfac040 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:52.359813 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-18b41a1a-3ff2-4f60-ab79-ca8f1dfac040 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:52.360263 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-18b41a1a-3ff2-4f60-ab79-ca8f1dfac040 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:52.361034 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-18b41a1a-3ff2-4f60-ab79-ca8f1dfac040 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:52.361465 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-18b41a1a-3ff2-4f60-ab79-ca8f1dfac040 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:52.387043 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-18b41a1a-3ff2-4f60-ab79-ca8f1dfac040 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53/ips" status: 200 len: 152 microversion: 2.20 time: 0.155207 Aug 01 14:25:52.387644 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 390/790] 10.222.0.17 () {60 vars in 1289 bytes} [Mon Aug 1 14:25:52 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53/ips => generated 152 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:25:54.232083 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e2372557-c259-456e-8894-8192c74db6c6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:54.232726 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e2372557-c259-456e-8894-8192c74db6c6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:54.238904 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e2372557-c259-456e-8894-8192c74db6c6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:54.239353 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e2372557-c259-456e-8894-8192c74db6c6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:54.240246 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e2372557-c259-456e-8894-8192c74db6c6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:54.240687 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e2372557-c259-456e-8894-8192c74db6c6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:54.268011 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-e2372557-c259-456e-8894-8192c74db6c6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lazy-loading 'flavor' on Instance uuid 40a79ecf-b103-42e0-9cd6-d1daacb03f53 {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:25:54.456618 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e2372557-c259-456e-8894-8192c74db6c6 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "POST /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53/action" status: 202 len: 0 microversion: 2.20 time: 0.229110 Aug 01 14:25:54.457223 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 401/791] 10.222.0.17 () {62 vars in 1319 bytes} [Mon Aug 1 14:25:54 2022] POST /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 01 14:25:54.465388 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b26d89b8-9320-426c-adbe-6c7f6274b774 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:54.465986 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b26d89b8-9320-426c-adbe-6c7f6274b774 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:54.472947 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b26d89b8-9320-426c-adbe-6c7f6274b774 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:54.473373 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b26d89b8-9320-426c-adbe-6c7f6274b774 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:54.474262 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b26d89b8-9320-426c-adbe-6c7f6274b774 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:54.474608 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b26d89b8-9320-426c-adbe-6c7f6274b774 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:54.608090 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b26d89b8-9320-426c-adbe-6c7f6274b774 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:54.616513 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b26d89b8-9320-426c-adbe-6c7f6274b774 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:54.618026 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b26d89b8-9320-426c-adbe-6c7f6274b774 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:54.619173 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b26d89b8-9320-426c-adbe-6c7f6274b774 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1723 microversion: 2.20 time: 0.157720 Aug 01 14:25:54.619758 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 391/792] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:54 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:25:55.643715 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b1af3e12-eafe-4031-9bca-2bab2b02fb0a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:55.644327 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b1af3e12-eafe-4031-9bca-2bab2b02fb0a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:55.650718 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b1af3e12-eafe-4031-9bca-2bab2b02fb0a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:55.651163 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b1af3e12-eafe-4031-9bca-2bab2b02fb0a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:55.651973 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b1af3e12-eafe-4031-9bca-2bab2b02fb0a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:55.652438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b1af3e12-eafe-4031-9bca-2bab2b02fb0a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:55.784331 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b1af3e12-eafe-4031-9bca-2bab2b02fb0a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:55.792224 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b1af3e12-eafe-4031-9bca-2bab2b02fb0a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:55.793717 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b1af3e12-eafe-4031-9bca-2bab2b02fb0a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:55.794898 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b1af3e12-eafe-4031-9bca-2bab2b02fb0a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1723 microversion: 2.20 time: 0.156097 Aug 01 14:25:55.795451 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 402/793] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:55 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:25:56.819219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-439d593d-0bb1-4a63-a9ef-7c95cf858259 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:56.819842 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-439d593d-0bb1-4a63-a9ef-7c95cf858259 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:56.826578 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-439d593d-0bb1-4a63-a9ef-7c95cf858259 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:56.827023 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-439d593d-0bb1-4a63-a9ef-7c95cf858259 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:56.827851 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-439d593d-0bb1-4a63-a9ef-7c95cf858259 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:56.828281 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-439d593d-0bb1-4a63-a9ef-7c95cf858259 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:56.958580 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-439d593d-0bb1-4a63-a9ef-7c95cf858259 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:56.966664 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-439d593d-0bb1-4a63-a9ef-7c95cf858259 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:56.968921 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-439d593d-0bb1-4a63-a9ef-7c95cf858259 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:56.970323 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-439d593d-0bb1-4a63-a9ef-7c95cf858259 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1723 microversion: 2.20 time: 0.155035 Aug 01 14:25:56.970876 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 392/794] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:56 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:25:57.993843 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5eeed673-6a6b-4fb1-a56e-e640bf026465 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:57.994445 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5eeed673-6a6b-4fb1-a56e-e640bf026465 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:58.001053 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5eeed673-6a6b-4fb1-a56e-e640bf026465 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:58.001500 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5eeed673-6a6b-4fb1-a56e-e640bf026465 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:58.002251 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5eeed673-6a6b-4fb1-a56e-e640bf026465 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:58.002681 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5eeed673-6a6b-4fb1-a56e-e640bf026465 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:58.136341 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5eeed673-6a6b-4fb1-a56e-e640bf026465 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:58.144896 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5eeed673-6a6b-4fb1-a56e-e640bf026465 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:58.146603 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5eeed673-6a6b-4fb1-a56e-e640bf026465 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:58.147805 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5eeed673-6a6b-4fb1-a56e-e640bf026465 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1723 microversion: 2.20 time: 0.158510 Aug 01 14:25:58.148372 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 403/795] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:57 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:25:59.171538 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b28b253e-889e-4a39-8809-b87fe4f2b187 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:59.172119 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b28b253e-889e-4a39-8809-b87fe4f2b187 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:59.178534 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b28b253e-889e-4a39-8809-b87fe4f2b187 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:59.178971 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b28b253e-889e-4a39-8809-b87fe4f2b187 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:59.180143 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b28b253e-889e-4a39-8809-b87fe4f2b187 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:59.180476 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b28b253e-889e-4a39-8809-b87fe4f2b187 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:59.316808 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b28b253e-889e-4a39-8809-b87fe4f2b187 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:59.324770 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b28b253e-889e-4a39-8809-b87fe4f2b187 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:59.326338 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b28b253e-889e-4a39-8809-b87fe4f2b187 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:59.327509 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b28b253e-889e-4a39-8809-b87fe4f2b187 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1723 microversion: 2.20 time: 0.159971 Aug 01 14:25:59.328691 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 393/796] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:59 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:00.351915 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ab4cb5dd-7d58-4821-adef-dc28319d459c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:00.352549 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ab4cb5dd-7d58-4821-adef-dc28319d459c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:00.359721 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ab4cb5dd-7d58-4821-adef-dc28319d459c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:00.360171 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ab4cb5dd-7d58-4821-adef-dc28319d459c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:00.360930 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ab4cb5dd-7d58-4821-adef-dc28319d459c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:00.361362 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ab4cb5dd-7d58-4821-adef-dc28319d459c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:00.490330 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ab4cb5dd-7d58-4821-adef-dc28319d459c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:00.500792 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ab4cb5dd-7d58-4821-adef-dc28319d459c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:00.502426 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ab4cb5dd-7d58-4821-adef-dc28319d459c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:00.503690 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ab4cb5dd-7d58-4821-adef-dc28319d459c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1723 microversion: 2.20 time: 0.155796 Aug 01 14:26:00.504264 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 404/797] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:00 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:01.526606 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-96433331-e793-403d-bb8b-2feb83548854 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:01.527206 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-96433331-e793-403d-bb8b-2feb83548854 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:01.533769 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-96433331-e793-403d-bb8b-2feb83548854 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:01.534216 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-96433331-e793-403d-bb8b-2feb83548854 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:01.534974 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-96433331-e793-403d-bb8b-2feb83548854 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:01.535407 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-96433331-e793-403d-bb8b-2feb83548854 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:01.666817 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-96433331-e793-403d-bb8b-2feb83548854 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:01.675598 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-96433331-e793-403d-bb8b-2feb83548854 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:01.677148 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-96433331-e793-403d-bb8b-2feb83548854 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:01.678323 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-96433331-e793-403d-bb8b-2feb83548854 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1723 microversion: 2.20 time: 0.155598 Aug 01 14:26:01.678886 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 394/798] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:01 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:02.701661 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ee51d2f8-1e88-4ea3-881c-2b1a772a3227 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:02.702270 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ee51d2f8-1e88-4ea3-881c-2b1a772a3227 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:02.708873 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ee51d2f8-1e88-4ea3-881c-2b1a772a3227 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:02.709321 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ee51d2f8-1e88-4ea3-881c-2b1a772a3227 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:02.710082 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ee51d2f8-1e88-4ea3-881c-2b1a772a3227 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:02.710519 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ee51d2f8-1e88-4ea3-881c-2b1a772a3227 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:02.843327 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ee51d2f8-1e88-4ea3-881c-2b1a772a3227 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:02.851614 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ee51d2f8-1e88-4ea3-881c-2b1a772a3227 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:02.853151 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ee51d2f8-1e88-4ea3-881c-2b1a772a3227 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:02.854305 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ee51d2f8-1e88-4ea3-881c-2b1a772a3227 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1723 microversion: 2.20 time: 0.156531 Aug 01 14:26:02.854857 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 405/799] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:02 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:03.878494 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-edb8809e-2415-44aa-abfa-2652a7dc6838 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:03.879092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-edb8809e-2415-44aa-abfa-2652a7dc6838 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:03.885691 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-edb8809e-2415-44aa-abfa-2652a7dc6838 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:03.886134 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-edb8809e-2415-44aa-abfa-2652a7dc6838 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:03.886895 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-edb8809e-2415-44aa-abfa-2652a7dc6838 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:03.887385 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-edb8809e-2415-44aa-abfa-2652a7dc6838 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:04.022382 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-edb8809e-2415-44aa-abfa-2652a7dc6838 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:04.030332 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-edb8809e-2415-44aa-abfa-2652a7dc6838 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:04.031877 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-edb8809e-2415-44aa-abfa-2652a7dc6838 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:04.033023 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-edb8809e-2415-44aa-abfa-2652a7dc6838 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1723 microversion: 2.20 time: 0.158977 Aug 01 14:26:04.033588 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 395/800] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:03 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:05.056767 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3e16b402-5302-42f6-ae58-f5898910abde tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:05.057352 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3e16b402-5302-42f6-ae58-f5898910abde tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:05.063896 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3e16b402-5302-42f6-ae58-f5898910abde tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:05.064339 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3e16b402-5302-42f6-ae58-f5898910abde tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:05.065100 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3e16b402-5302-42f6-ae58-f5898910abde tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:05.065528 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3e16b402-5302-42f6-ae58-f5898910abde tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:05.195491 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3e16b402-5302-42f6-ae58-f5898910abde tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:05.204029 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3e16b402-5302-42f6-ae58-f5898910abde tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:05.205556 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3e16b402-5302-42f6-ae58-f5898910abde tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:05.206767 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3e16b402-5302-42f6-ae58-f5898910abde tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1744 microversion: 2.20 time: 0.153991 Aug 01 14:26:05.207332 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 406/801] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:05 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:26:06.229957 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e4408fae-6d79-4c7d-9eee-b5259e14dca3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:06.231979 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e4408fae-6d79-4c7d-9eee-b5259e14dca3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:06.237833 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e4408fae-6d79-4c7d-9eee-b5259e14dca3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:06.238275 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e4408fae-6d79-4c7d-9eee-b5259e14dca3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:06.239035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e4408fae-6d79-4c7d-9eee-b5259e14dca3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:06.239484 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e4408fae-6d79-4c7d-9eee-b5259e14dca3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:06.376870 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e4408fae-6d79-4c7d-9eee-b5259e14dca3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:06.388214 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e4408fae-6d79-4c7d-9eee-b5259e14dca3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:06.389700 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e4408fae-6d79-4c7d-9eee-b5259e14dca3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:06.391584 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e4408fae-6d79-4c7d-9eee-b5259e14dca3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1744 microversion: 2.20 time: 0.165375 Aug 01 14:26:06.392020 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 396/802] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:06 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:07.415444 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6853e12d-99d5-49aa-a6e2-e2e64cafd89c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:07.416075 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-6853e12d-99d5-49aa-a6e2-e2e64cafd89c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:07.422599 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6853e12d-99d5-49aa-a6e2-e2e64cafd89c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:07.423076 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6853e12d-99d5-49aa-a6e2-e2e64cafd89c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:07.423875 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6853e12d-99d5-49aa-a6e2-e2e64cafd89c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:07.424306 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6853e12d-99d5-49aa-a6e2-e2e64cafd89c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:07.554475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6853e12d-99d5-49aa-a6e2-e2e64cafd89c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:07.556871 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:07.565099 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6853e12d-99d5-49aa-a6e2-e2e64cafd89c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:07.566590 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6853e12d-99d5-49aa-a6e2-e2e64cafd89c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:07.567774 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6853e12d-99d5-49aa-a6e2-e2e64cafd89c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1744 microversion: 2.20 time: 0.156311 Aug 01 14:26:07.568344 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 407/803] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:07 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:08.554143 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-340a6314-0d3f-4d10-bde4-0fb5e34ac53f req-c64f0383-f928-43b0-b2df-a445fb953b87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40a79ecf-b103-42e0-9cd6-d1daacb03f53", "name": "network-vif-plugged", "status": "completed", "tag": "0379a8d6-df19-44b8-a731-76a7821a7444"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:26:08.564030 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-340a6314-0d3f-4d10-bde4-0fb5e34ac53f req-c64f0383-f928-43b0-b2df-a445fb953b87 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:08.564474 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-340a6314-0d3f-4d10-bde4-0fb5e34ac53f req-c64f0383-f928-43b0-b2df-a445fb953b87 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:08.568805 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:08.579292 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-340a6314-0d3f-4d10-bde4-0fb5e34ac53f req-c64f0383-f928-43b0-b2df-a445fb953b87 service nova] Creating event network-vif-plugged:0379a8d6-df19-44b8-a731-76a7821a7444 for instance 40a79ecf-b103-42e0-9cd6-d1daacb03f53 on hv-cinder-84599 Aug 01 14:26:08.584528 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-340a6314-0d3f-4d10-bde4-0fb5e34ac53f req-c64f0383-f928-43b0-b2df-a445fb953b87 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119670 Aug 01 14:26:08.585800 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 397/804] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:26:08.590666 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-235139b1-7ede-44af-a5c5-555537b85afe tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:08.596306 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-235139b1-7ede-44af-a5c5-555537b85afe tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:08.604707 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-235139b1-7ede-44af-a5c5-555537b85afe tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:08.605153 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-235139b1-7ede-44af-a5c5-555537b85afe tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:08.605917 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-235139b1-7ede-44af-a5c5-555537b85afe tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:08.606522 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-235139b1-7ede-44af-a5c5-555537b85afe tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:08.757512 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-235139b1-7ede-44af-a5c5-555537b85afe tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:08.767244 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-235139b1-7ede-44af-a5c5-555537b85afe tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:08.771970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-235139b1-7ede-44af-a5c5-555537b85afe tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:08.773556 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-235139b1-7ede-44af-a5c5-555537b85afe tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1739 microversion: 2.20 time: 0.187007 Aug 01 14:26:08.774330 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 408/805] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:08 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:09.798195 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-493ad484-db5e-41fe-abfe-67e14a58d172 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:09.799676 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-493ad484-db5e-41fe-abfe-67e14a58d172 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:09.807007 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-493ad484-db5e-41fe-abfe-67e14a58d172 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:09.807447 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-493ad484-db5e-41fe-abfe-67e14a58d172 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:09.808451 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-493ad484-db5e-41fe-abfe-67e14a58d172 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:09.809050 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-493ad484-db5e-41fe-abfe-67e14a58d172 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:09.957718 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-493ad484-db5e-41fe-abfe-67e14a58d172 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:09.965809 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-493ad484-db5e-41fe-abfe-67e14a58d172 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:09.967331 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-493ad484-db5e-41fe-abfe-67e14a58d172 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:09.969010 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-493ad484-db5e-41fe-abfe-67e14a58d172 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1739 microversion: 2.20 time: 0.175951 Aug 01 14:26:09.970001 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 398/806] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:09 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:10.995371 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-05e3fca5-3e7b-4c4e-843d-abd2a2201e1c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:10.996046 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-05e3fca5-3e7b-4c4e-843d-abd2a2201e1c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:11.003650 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05e3fca5-3e7b-4c4e-843d-abd2a2201e1c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:11.004352 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05e3fca5-3e7b-4c4e-843d-abd2a2201e1c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:11.005300 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05e3fca5-3e7b-4c4e-843d-abd2a2201e1c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:11.005943 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05e3fca5-3e7b-4c4e-843d-abd2a2201e1c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:11.156701 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-05e3fca5-3e7b-4c4e-843d-abd2a2201e1c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:11.167445 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-05e3fca5-3e7b-4c4e-843d-abd2a2201e1c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:11.169447 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-05e3fca5-3e7b-4c4e-843d-abd2a2201e1c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:11.171588 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-05e3fca5-3e7b-4c4e-843d-abd2a2201e1c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1739 microversion: 2.20 time: 0.181481 Aug 01 14:26:11.172145 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 409/807] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:10 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:12.200283 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-53a2306f-564d-4d16-9dbb-1a030df12c1f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:12.201823 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-53a2306f-564d-4d16-9dbb-1a030df12c1f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:12.209995 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-53a2306f-564d-4d16-9dbb-1a030df12c1f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:12.210831 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-53a2306f-564d-4d16-9dbb-1a030df12c1f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:12.212026 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-53a2306f-564d-4d16-9dbb-1a030df12c1f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:12.212513 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-53a2306f-564d-4d16-9dbb-1a030df12c1f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:12.618933 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-53a2306f-564d-4d16-9dbb-1a030df12c1f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:12.633829 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-53a2306f-564d-4d16-9dbb-1a030df12c1f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:12.641482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-53a2306f-564d-4d16-9dbb-1a030df12c1f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:12.642705 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-53a2306f-564d-4d16-9dbb-1a030df12c1f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1739 microversion: 2.20 time: 0.446480 Aug 01 14:26:12.643259 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 399/808] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:12 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1739 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:13.666931 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ebd06090-8aa2-4707-bb38-00f8a0305171 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:13.668119 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ebd06090-8aa2-4707-bb38-00f8a0305171 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:13.676238 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ebd06090-8aa2-4707-bb38-00f8a0305171 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:13.676695 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ebd06090-8aa2-4707-bb38-00f8a0305171 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:13.677472 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ebd06090-8aa2-4707-bb38-00f8a0305171 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:13.678095 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ebd06090-8aa2-4707-bb38-00f8a0305171 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:13.823917 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ebd06090-8aa2-4707-bb38-00f8a0305171 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:13.834985 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ebd06090-8aa2-4707-bb38-00f8a0305171 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:13.836529 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ebd06090-8aa2-4707-bb38-00f8a0305171 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:13.837710 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ebd06090-8aa2-4707-bb38-00f8a0305171 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1739 microversion: 2.20 time: 0.174673 Aug 01 14:26:13.838278 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 410/809] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:13 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:14.862325 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a57aad25-a9ef-4e67-9b10-bbe2026e09a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:14.863315 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a57aad25-a9ef-4e67-9b10-bbe2026e09a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:14.870564 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a57aad25-a9ef-4e67-9b10-bbe2026e09a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:14.871219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a57aad25-a9ef-4e67-9b10-bbe2026e09a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:14.871976 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a57aad25-a9ef-4e67-9b10-bbe2026e09a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:14.872276 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a57aad25-a9ef-4e67-9b10-bbe2026e09a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:15.025291 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a57aad25-a9ef-4e67-9b10-bbe2026e09a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:15.035925 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a57aad25-a9ef-4e67-9b10-bbe2026e09a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:15.037859 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a57aad25-a9ef-4e67-9b10-bbe2026e09a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:15.039039 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a57aad25-a9ef-4e67-9b10-bbe2026e09a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1739 microversion: 2.20 time: 0.181492 Aug 01 14:26:15.039988 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 400/810] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:14 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:16.062655 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f367e193-6ab8-49c5-b7c5-faaa06a6caab tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:16.063423 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f367e193-6ab8-49c5-b7c5-faaa06a6caab tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:16.065764 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=34 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:16.071229 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f367e193-6ab8-49c5-b7c5-faaa06a6caab tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:16.072219 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f367e193-6ab8-49c5-b7c5-faaa06a6caab tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:16.072468 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f367e193-6ab8-49c5-b7c5-faaa06a6caab tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:16.072903 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f367e193-6ab8-49c5-b7c5-faaa06a6caab tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:16.225385 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f367e193-6ab8-49c5-b7c5-faaa06a6caab tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:16.236730 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f367e193-6ab8-49c5-b7c5-faaa06a6caab tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:16.238263 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f367e193-6ab8-49c5-b7c5-faaa06a6caab tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:16.239431 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f367e193-6ab8-49c5-b7c5-faaa06a6caab tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1739 microversion: 2.20 time: 0.181107 Aug 01 14:26:16.251601 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 411/811] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:16 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:16.820406 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-995bce9a-49ae-4667-81e1-96058cf4430d tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:26:16.822667 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-995bce9a-49ae-4667-81e1-96058cf4430d tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:16.825094 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=32 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:16.830401 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-995bce9a-49ae-4667-81e1-96058cf4430d tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:16.830848 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-995bce9a-49ae-4667-81e1-96058cf4430d tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:16.831706 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-995bce9a-49ae-4667-81e1-96058cf4430d tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:16.832159 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-995bce9a-49ae-4667-81e1-96058cf4430d tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:16.908519 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-995bce9a-49ae-4667-81e1-96058cf4430d tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "POST /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f/action" status: 202 len: 0 microversion: 2.1 time: 0.091674 Aug 01 14:26:16.909140 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 401/812] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Aug 1 14:26:16 2022] POST /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:26:16.917287 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-00ecdf89-b2d7-43f4-b92a-c5e09a3bbc10 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:16.917840 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-00ecdf89-b2d7-43f4-b92a-c5e09a3bbc10 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:16.923920 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-00ecdf89-b2d7-43f4-b92a-c5e09a3bbc10 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:16.924370 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-00ecdf89-b2d7-43f4-b92a-c5e09a3bbc10 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:16.925131 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-00ecdf89-b2d7-43f4-b92a-c5e09a3bbc10 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:16.925586 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-00ecdf89-b2d7-43f4-b92a-c5e09a3bbc10 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:17.108383 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-00ecdf89-b2d7-43f4-b92a-c5e09a3bbc10 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:17.116343 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-00ecdf89-b2d7-43f4-b92a-c5e09a3bbc10 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1751 microversion: 2.1 time: 0.202955 Aug 01 14:26:17.116918 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 412/813] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:16 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1751 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:26:17.262659 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-24b432d7-c8d9-4152-b49c-66c55fb0d7a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:17.263468 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-24b432d7-c8d9-4152-b49c-66c55fb0d7a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:17.270838 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-24b432d7-c8d9-4152-b49c-66c55fb0d7a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:17.271110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-24b432d7-c8d9-4152-b49c-66c55fb0d7a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:17.271906 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-24b432d7-c8d9-4152-b49c-66c55fb0d7a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:17.272339 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-24b432d7-c8d9-4152-b49c-66c55fb0d7a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:17.409873 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-24b432d7-c8d9-4152-b49c-66c55fb0d7a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:17.417805 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-24b432d7-c8d9-4152-b49c-66c55fb0d7a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:17.419311 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-24b432d7-c8d9-4152-b49c-66c55fb0d7a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:17.420559 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-24b432d7-c8d9-4152-b49c-66c55fb0d7a0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1739 microversion: 2.20 time: 0.162181 Aug 01 14:26:17.421110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 402/814] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:17 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:26:18.137268 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-10448bb3-6c22-4ff3-9251-42be83bc8771 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:18.137872 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-10448bb3-6c22-4ff3-9251-42be83bc8771 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:18.144350 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-10448bb3-6c22-4ff3-9251-42be83bc8771 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:18.144795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-10448bb3-6c22-4ff3-9251-42be83bc8771 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:18.145554 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-10448bb3-6c22-4ff3-9251-42be83bc8771 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:18.145992 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-10448bb3-6c22-4ff3-9251-42be83bc8771 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:18.443357 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-cfe60def-02a9-44e7-9884-42d9c8efee4d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:18.443968 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-cfe60def-02a9-44e7-9884-42d9c8efee4d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:18.450916 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cfe60def-02a9-44e7-9884-42d9c8efee4d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:18.451386 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cfe60def-02a9-44e7-9884-42d9c8efee4d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:18.452698 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cfe60def-02a9-44e7-9884-42d9c8efee4d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:18.453119 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cfe60def-02a9-44e7-9884-42d9c8efee4d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:18.591539 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-cfe60def-02a9-44e7-9884-42d9c8efee4d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:18.601704 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-cfe60def-02a9-44e7-9884-42d9c8efee4d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:18.603216 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-cfe60def-02a9-44e7-9884-42d9c8efee4d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:18.604652 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-cfe60def-02a9-44e7-9884-42d9c8efee4d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1721 microversion: 2.20 time: 0.165560 Aug 01 14:26:18.605404 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 403/815] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:18 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:26:18.626419 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-10448bb3-6c22-4ff3-9251-42be83bc8771 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:18.634506 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-10448bb3-6c22-4ff3-9251-42be83bc8771 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1751 microversion: 2.1 time: 0.501063 Aug 01 14:26:18.635066 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 413/816] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:18 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1751 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:19.628566 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-4c5f2b22-4168-44a8-9749-ce8bd3d0ee35 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:19.629144 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-4c5f2b22-4168-44a8-9749-ce8bd3d0ee35 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:19.635653 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4c5f2b22-4168-44a8-9749-ce8bd3d0ee35 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:19.636123 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4c5f2b22-4168-44a8-9749-ce8bd3d0ee35 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:19.636881 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4c5f2b22-4168-44a8-9749-ce8bd3d0ee35 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:19.637309 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4c5f2b22-4168-44a8-9749-ce8bd3d0ee35 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:19.656836 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e8077f0b-94d4-469c-bf8f-3fa24b1df468 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:19.657507 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e8077f0b-94d4-469c-bf8f-3fa24b1df468 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:19.663976 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e8077f0b-94d4-469c-bf8f-3fa24b1df468 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:19.664426 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e8077f0b-94d4-469c-bf8f-3fa24b1df468 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:19.665183 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e8077f0b-94d4-469c-bf8f-3fa24b1df468 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:19.665614 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e8077f0b-94d4-469c-bf8f-3fa24b1df468 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:19.771326 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4c5f2b22-4168-44a8-9749-ce8bd3d0ee35 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:19.779622 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4c5f2b22-4168-44a8-9749-ce8bd3d0ee35 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:19.781827 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4c5f2b22-4168-44a8-9749-ce8bd3d0ee35 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:19.783164 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-4c5f2b22-4168-44a8-9749-ce8bd3d0ee35 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1721 microversion: 2.20 time: 0.158621 Aug 01 14:26:19.783954 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 404/817] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:19 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:19.813610 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e8077f0b-94d4-469c-bf8f-3fa24b1df468 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:19.821546 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e8077f0b-94d4-469c-bf8f-3fa24b1df468 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1756 microversion: 2.1 time: 0.169246 Aug 01 14:26:19.822104 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 414/818] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:19 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:26:20.415161 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-eb52abac-e7e6-4034-bd0b-a6481e0a4555 req-186d6f42-cf98-4dce-80a4-fb983b8d955c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40a79ecf-b103-42e0-9cd6-d1daacb03f53", "name": "network-vif-unplugged", "status": "completed", "tag": "0379a8d6-df19-44b8-a731-76a7821a7444"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:26:20.425295 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-eb52abac-e7e6-4034-bd0b-a6481e0a4555 req-186d6f42-cf98-4dce-80a4-fb983b8d955c service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:20.425846 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-eb52abac-e7e6-4034-bd0b-a6481e0a4555 req-186d6f42-cf98-4dce-80a4-fb983b8d955c service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:20.437788 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-eb52abac-e7e6-4034-bd0b-a6481e0a4555 req-186d6f42-cf98-4dce-80a4-fb983b8d955c service nova] Creating event network-vif-unplugged:0379a8d6-df19-44b8-a731-76a7821a7444 for instance 40a79ecf-b103-42e0-9cd6-d1daacb03f53 on hv-cinder-84599 Aug 01 14:26:20.442573 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-eb52abac-e7e6-4034-bd0b-a6481e0a4555 req-186d6f42-cf98-4dce-80a4-fb983b8d955c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031100 Aug 01 14:26:20.443159 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 405/819] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:26:20.805885 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-97757b9e-e1d9-43c7-8df5-38f1c7346014 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:20.806490 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-97757b9e-e1d9-43c7-8df5-38f1c7346014 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:20.813749 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-97757b9e-e1d9-43c7-8df5-38f1c7346014 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:20.814202 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-97757b9e-e1d9-43c7-8df5-38f1c7346014 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:20.814977 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-97757b9e-e1d9-43c7-8df5-38f1c7346014 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:20.815415 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-97757b9e-e1d9-43c7-8df5-38f1c7346014 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:20.845187 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-266f1fa9-0ceb-484c-81b3-1571c324cabe tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:20.845876 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-266f1fa9-0ceb-484c-81b3-1571c324cabe tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:20.852152 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-266f1fa9-0ceb-484c-81b3-1571c324cabe tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:20.852591 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-266f1fa9-0ceb-484c-81b3-1571c324cabe tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:20.853353 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-266f1fa9-0ceb-484c-81b3-1571c324cabe tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:20.853782 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-266f1fa9-0ceb-484c-81b3-1571c324cabe tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:20.949231 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-97757b9e-e1d9-43c7-8df5-38f1c7346014 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:20.957600 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-97757b9e-e1d9-43c7-8df5-38f1c7346014 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:20.959099 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-97757b9e-e1d9-43c7-8df5-38f1c7346014 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:20.960284 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-97757b9e-e1d9-43c7-8df5-38f1c7346014 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1724 microversion: 2.20 time: 0.158351 Aug 01 14:26:20.961058 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 415/820] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:20 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:20.986914 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a1a1066b-2b8f-4c4b-8cc5-ac3175c8ff27 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1cb65e24-3774-4eb8-b208-9ce73e6c2051"}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:26:20.989512 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a1a1066b-2b8f-4c4b-8cc5-ac3175c8ff27 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:20.996073 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a1a1066b-2b8f-4c4b-8cc5-ac3175c8ff27 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:20.996739 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a1a1066b-2b8f-4c4b-8cc5-ac3175c8ff27 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:20.997600 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a1a1066b-2b8f-4c4b-8cc5-ac3175c8ff27 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:20.998096 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a1a1066b-2b8f-4c4b-8cc5-ac3175c8ff27 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:21.012476 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-266f1fa9-0ceb-484c-81b3-1571c324cabe tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:21.021283 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-266f1fa9-0ceb-484c-81b3-1571c324cabe tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1756 microversion: 2.1 time: 0.180965 Aug 01 14:26:21.022027 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 406/821] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:20 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:26:21.266903 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a1a1066b-2b8f-4c4b-8cc5-ac3175c8ff27 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "POST /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.285422 Aug 01 14:26:21.267536 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 416/822] 10.222.0.17 () {62 vars in 1364 bytes} [Mon Aug 1 14:26:20 2022] POST /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53/os-volume_attachments => generated 188 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 14:26:21.390655 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-af12f74b-c663-454e-8b05-ef59a21cb640 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:21.391144 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-af12f74b-c663-454e-8b05-ef59a21cb640 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:21.397159 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-af12f74b-c663-454e-8b05-ef59a21cb640 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:21.397604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-af12f74b-c663-454e-8b05-ef59a21cb640 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:21.398365 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-af12f74b-c663-454e-8b05-ef59a21cb640 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:21.398795 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-af12f74b-c663-454e-8b05-ef59a21cb640 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:21.653537 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-af12f74b-c663-454e-8b05-ef59a21cb640 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "DELETE /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53/os-volume_attachments/1cb65e24-3774-4eb8-b208-9ce73e6c2051" status: 202 len: 0 microversion: 2.20 time: 0.266638 Aug 01 14:26:21.654293 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 407/823] 10.222.0.17 () {60 vars in 1457 bytes} [Mon Aug 1 14:26:21 2022] DELETE /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53/os-volume_attachments/1cb65e24-3774-4eb8-b208-9ce73e6c2051 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:26:21.715793 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c650e3f2-8f49-495b-a903-878adee34a0d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:26:21.716377 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c650e3f2-8f49-495b-a903-878adee34a0d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:21.723096 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c650e3f2-8f49-495b-a903-878adee34a0d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:21.723577 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c650e3f2-8f49-495b-a903-878adee34a0d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:21.724332 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c650e3f2-8f49-495b-a903-878adee34a0d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:21.724762 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c650e3f2-8f49-495b-a903-878adee34a0d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:21.767366 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c650e3f2-8f49-495b-a903-878adee34a0d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118132) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 14:26:21.835504 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c650e3f2-8f49-495b-a903-878adee34a0d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "POST /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53/action" status: 202 len: 0 microversion: 2.20 time: 0.123432 Aug 01 14:26:21.836532 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 417/824] 10.222.0.17 () {62 vars in 1319 bytes} [Mon Aug 1 14:26:21 2022] POST /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:26:21.845716 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f09a2680-d647-4399-876f-8c0c4abb2689 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:21.846414 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f09a2680-d647-4399-876f-8c0c4abb2689 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:21.853699 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f09a2680-d647-4399-876f-8c0c4abb2689 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:21.854148 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f09a2680-d647-4399-876f-8c0c4abb2689 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:21.854917 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f09a2680-d647-4399-876f-8c0c4abb2689 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:21.855359 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f09a2680-d647-4399-876f-8c0c4abb2689 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:22.032372 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f09a2680-d647-4399-876f-8c0c4abb2689 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:22.041339 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f09a2680-d647-4399-876f-8c0c4abb2689 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:22.042221 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6a06da1d-e409-4530-b455-1ae01fd0249b tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:22.042913 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-6a06da1d-e409-4530-b455-1ae01fd0249b tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:22.043089 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f09a2680-d647-4399-876f-8c0c4abb2689 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:22.044497 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f09a2680-d647-4399-876f-8c0c4abb2689 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1672 microversion: 2.20 time: 0.203676 Aug 01 14:26:22.055511 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 408/825] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:21 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1672 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:26:22.055716 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6a06da1d-e409-4530-b455-1ae01fd0249b tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:22.055716 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6a06da1d-e409-4530-b455-1ae01fd0249b tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:22.055716 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6a06da1d-e409-4530-b455-1ae01fd0249b tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:22.055716 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6a06da1d-e409-4530-b455-1ae01fd0249b tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:22.196718 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6a06da1d-e409-4530-b455-1ae01fd0249b tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:22.205265 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6a06da1d-e409-4530-b455-1ae01fd0249b tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1756 microversion: 2.1 time: 0.166846 Aug 01 14:26:22.205772 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 418/826] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:22 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:26:22.786220 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c28f9e7e-0fe0-4bc1-b908-5784bd01c5c5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:22.786710 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c28f9e7e-0fe0-4bc1-b908-5784bd01c5c5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:22.792701 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c28f9e7e-0fe0-4bc1-b908-5784bd01c5c5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:22.793150 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c28f9e7e-0fe0-4bc1-b908-5784bd01c5c5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:22.793908 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c28f9e7e-0fe0-4bc1-b908-5784bd01c5c5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:22.794339 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c28f9e7e-0fe0-4bc1-b908-5784bd01c5c5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:22.874413 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-c28f9e7e-0fe0-4bc1-b908-5784bd01c5c5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lazy-loading 'services' on Instance uuid 5664fd60-279c-4671-9a77-a5bc99baf7be {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:26:22.949745 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c28f9e7e-0fe0-4bc1-b908-5784bd01c5c5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be/os-volume_attachments/6360ecf5-f1af-47a6-ad3c-f62caf62274d" status: 202 len: 0 microversion: 2.1 time: 0.167181 Aug 01 14:26:22.953522 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 409/827] 10.222.0.17 () {58 vars in 1416 bytes} [Mon Aug 1 14:26:22 2022] DELETE /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be/os-volume_attachments/6360ecf5-f1af-47a6-ad3c-f62caf62274d => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:26:22.958905 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e38868d4-e3db-4062-b2f6-5b6a8d1ddecf tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:22.961242 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e38868d4-e3db-4062-b2f6-5b6a8d1ddecf tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:22.970989 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e38868d4-e3db-4062-b2f6-5b6a8d1ddecf tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:22.971556 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e38868d4-e3db-4062-b2f6-5b6a8d1ddecf tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:22.974822 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e38868d4-e3db-4062-b2f6-5b6a8d1ddecf tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:22.975582 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e38868d4-e3db-4062-b2f6-5b6a8d1ddecf tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:23.009224 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e38868d4-e3db-4062-b2f6-5b6a8d1ddecf tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054314 Aug 01 14:26:23.009794 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 419/828] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Aug 1 14:26:22 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:26:23.070471 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3a92a1ae-3e31-4fe8-bd27-56086fc63f49 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:23.071578 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3a92a1ae-3e31-4fe8-bd27-56086fc63f49 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:23.079308 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3a92a1ae-3e31-4fe8-bd27-56086fc63f49 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:23.080780 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3a92a1ae-3e31-4fe8-bd27-56086fc63f49 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:23.081631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3a92a1ae-3e31-4fe8-bd27-56086fc63f49 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:23.082156 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3a92a1ae-3e31-4fe8-bd27-56086fc63f49 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:23.215804 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3a92a1ae-3e31-4fe8-bd27-56086fc63f49 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:23.220079 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:23.226631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3a92a1ae-3e31-4fe8-bd27-56086fc63f49 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:23.227210 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f0e774c3-d56a-4df9-a1e5-fd8b125f1590 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:23.227842 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f0e774c3-d56a-4df9-a1e5-fd8b125f1590 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:23.228248 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3a92a1ae-3e31-4fe8-bd27-56086fc63f49 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:23.229450 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3a92a1ae-3e31-4fe8-bd27-56086fc63f49 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1730 microversion: 2.20 time: 0.164680 Aug 01 14:26:23.230016 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 410/829] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:23 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:23.234607 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f0e774c3-d56a-4df9-a1e5-fd8b125f1590 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:23.235050 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f0e774c3-d56a-4df9-a1e5-fd8b125f1590 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:23.235841 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f0e774c3-d56a-4df9-a1e5-fd8b125f1590 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:23.236277 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f0e774c3-d56a-4df9-a1e5-fd8b125f1590 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:23.381126 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f0e774c3-d56a-4df9-a1e5-fd8b125f1590 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:23.383285 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:23.390099 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f0e774c3-d56a-4df9-a1e5-fd8b125f1590 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1756 microversion: 2.1 time: 0.166722 Aug 01 14:26:23.390662 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 420/830] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:23 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:26:24.023786 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-1275cd88-c345-4d73-903d-709d1f2960c3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:24.026138 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1275cd88-c345-4d73-903d-709d1f2960c3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:24.036283 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1275cd88-c345-4d73-903d-709d1f2960c3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:24.036605 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1275cd88-c345-4d73-903d-709d1f2960c3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:24.037376 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1275cd88-c345-4d73-903d-709d1f2960c3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:24.037803 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1275cd88-c345-4d73-903d-709d1f2960c3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:24.075513 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-1275cd88-c345-4d73-903d-709d1f2960c3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056830 Aug 01 14:26:24.079577 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 411/831] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Aug 1 14:26:24 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:26:24.253669 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7e9c65b4-3842-4081-982e-9e32c4f8587c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:24.254362 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7e9c65b4-3842-4081-982e-9e32c4f8587c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:24.262281 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7e9c65b4-3842-4081-982e-9e32c4f8587c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:24.263044 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7e9c65b4-3842-4081-982e-9e32c4f8587c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:24.263486 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7e9c65b4-3842-4081-982e-9e32c4f8587c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:24.263925 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7e9c65b4-3842-4081-982e-9e32c4f8587c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:24.414460 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-dbb8e9fd-ae61-47e4-9f44-7b210399fabe tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:24.415927 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-dbb8e9fd-ae61-47e4-9f44-7b210399fabe tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:24.421380 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7e9c65b4-3842-4081-982e-9e32c4f8587c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:24.430629 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dbb8e9fd-ae61-47e4-9f44-7b210399fabe tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:24.431101 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dbb8e9fd-ae61-47e4-9f44-7b210399fabe tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:24.432100 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7e9c65b4-3842-4081-982e-9e32c4f8587c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:24.432250 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dbb8e9fd-ae61-47e4-9f44-7b210399fabe tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:24.432631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dbb8e9fd-ae61-47e4-9f44-7b210399fabe tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:24.434259 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7e9c65b4-3842-4081-982e-9e32c4f8587c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:24.435757 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7e9c65b4-3842-4081-982e-9e32c4f8587c tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1730 microversion: 2.20 time: 0.186677 Aug 01 14:26:24.438061 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 421/832] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:24 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:24.680428 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-dbb8e9fd-ae61-47e4-9f44-7b210399fabe tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:24.694172 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-dbb8e9fd-ae61-47e4-9f44-7b210399fabe tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1756 microversion: 2.1 time: 0.286091 Aug 01 14:26:24.696395 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 412/833] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:24 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1756 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:26:25.087812 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-eec5a291-144c-4bb0-80ce-ef162c1140dd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:25.090463 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-eec5a291-144c-4bb0-80ce-ef162c1140dd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:25.097613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eec5a291-144c-4bb0-80ce-ef162c1140dd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:25.098190 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eec5a291-144c-4bb0-80ce-ef162c1140dd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:25.099020 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eec5a291-144c-4bb0-80ce-ef162c1140dd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:25.099476 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-eec5a291-144c-4bb0-80ce-ef162c1140dd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:25.133010 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-eec5a291-144c-4bb0-80ce-ef162c1140dd tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049345 Aug 01 14:26:25.138950 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 422/834] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Aug 1 14:26:25 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 01 14:26:25.216928 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-cd8bd7e2-da80-4ffb-9b4a-504b7ab61883 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:25.217578 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-cd8bd7e2-da80-4ffb-9b4a-504b7ab61883 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:25.224598 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cd8bd7e2-da80-4ffb-9b4a-504b7ab61883 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:25.225051 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cd8bd7e2-da80-4ffb-9b4a-504b7ab61883 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:25.225827 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cd8bd7e2-da80-4ffb-9b4a-504b7ab61883 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:25.226267 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cd8bd7e2-da80-4ffb-9b4a-504b7ab61883 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:25.253546 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-cd8bd7e2-da80-4ffb-9b4a-504b7ab61883 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Going to try to terminate instance {{(pid=118133) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:26:25.346829 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-cd8bd7e2-da80-4ffb-9b4a-504b7ab61883 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 204 len: 0 microversion: 2.1 time: 0.133363 Aug 01 14:26:25.347717 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 413/835] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Aug 1 14:26:25 2022] DELETE /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:26:25.355569 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4dcacf2b-edb3-4681-9b79-d4d1dd8aa1b3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:25.356182 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4dcacf2b-edb3-4681-9b79-d4d1dd8aa1b3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:25.363163 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4dcacf2b-edb3-4681-9b79-d4d1dd8aa1b3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:25.363662 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4dcacf2b-edb3-4681-9b79-d4d1dd8aa1b3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:25.364430 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4dcacf2b-edb3-4681-9b79-d4d1dd8aa1b3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:25.365349 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4dcacf2b-edb3-4681-9b79-d4d1dd8aa1b3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:25.458958 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e3e4c372-7cf9-48f1-9512-192ffdecd1a3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:25.459680 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e3e4c372-7cf9-48f1-9512-192ffdecd1a3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:25.465732 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e3e4c372-7cf9-48f1-9512-192ffdecd1a3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:25.466178 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e3e4c372-7cf9-48f1-9512-192ffdecd1a3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:25.466979 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e3e4c372-7cf9-48f1-9512-192ffdecd1a3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:25.467968 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e3e4c372-7cf9-48f1-9512-192ffdecd1a3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:25.530457 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4dcacf2b-edb3-4681-9b79-d4d1dd8aa1b3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:25.543649 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4dcacf2b-edb3-4681-9b79-d4d1dd8aa1b3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1689 microversion: 2.1 time: 0.191231 Aug 01 14:26:25.556127 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 423/836] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:25 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1689 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:25.632679 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e3e4c372-7cf9-48f1-9512-192ffdecd1a3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:25.641782 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e3e4c372-7cf9-48f1-9512-192ffdecd1a3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:25.643391 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e3e4c372-7cf9-48f1-9512-192ffdecd1a3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:25.644644 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e3e4c372-7cf9-48f1-9512-192ffdecd1a3 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1730 microversion: 2.20 time: 0.190224 Aug 01 14:26:25.645208 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 414/837] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:25 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:26:25.721238 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-be289c8f-f4d2-4279-bebb-71cb36e8b42e tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:25.721849 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-be289c8f-f4d2-4279-bebb-71cb36e8b42e tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:25.727981 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-be289c8f-f4d2-4279-bebb-71cb36e8b42e tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:25.728430 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-be289c8f-f4d2-4279-bebb-71cb36e8b42e tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:25.729200 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-be289c8f-f4d2-4279-bebb-71cb36e8b42e tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:25.729628 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-be289c8f-f4d2-4279-bebb-71cb36e8b42e tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:25.881576 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-be289c8f-f4d2-4279-bebb-71cb36e8b42e tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:25.892347 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-be289c8f-f4d2-4279-bebb-71cb36e8b42e tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1756 microversion: 2.1 time: 0.175215 Aug 01 14:26:25.892937 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 424/838] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:25 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:26.566696 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-cc7690dd-abc8-46c7-ac88-d51cd7991e2f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:26.567343 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-cc7690dd-abc8-46c7-ac88-d51cd7991e2f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:26.574171 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cc7690dd-abc8-46c7-ac88-d51cd7991e2f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:26.574625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cc7690dd-abc8-46c7-ac88-d51cd7991e2f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:26.575389 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cc7690dd-abc8-46c7-ac88-d51cd7991e2f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:26.575852 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cc7690dd-abc8-46c7-ac88-d51cd7991e2f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:26.677321 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-85409295-81a2-4cd4-892b-a790ab9c7532 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:26.678143 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-85409295-81a2-4cd4-892b-a790ab9c7532 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:26.688995 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-85409295-81a2-4cd4-892b-a790ab9c7532 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:26.689517 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-85409295-81a2-4cd4-892b-a790ab9c7532 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:26.690303 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-85409295-81a2-4cd4-892b-a790ab9c7532 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:26.690838 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-85409295-81a2-4cd4-892b-a790ab9c7532 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:26.792238 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-cc7690dd-abc8-46c7-ac88-d51cd7991e2f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:26.824278 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-cc7690dd-abc8-46c7-ac88-d51cd7991e2f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1689 microversion: 2.1 time: 0.250400 Aug 01 14:26:26.825481 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 415/839] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:26 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1689 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:26.919430 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c4a527c6-cf3f-423e-ae58-410ac3031093 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:26.920232 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c4a527c6-cf3f-423e-ae58-410ac3031093 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:26.930428 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c4a527c6-cf3f-423e-ae58-410ac3031093 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:26.931021 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c4a527c6-cf3f-423e-ae58-410ac3031093 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:26.932196 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c4a527c6-cf3f-423e-ae58-410ac3031093 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:26.932741 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c4a527c6-cf3f-423e-ae58-410ac3031093 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:26.944960 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-85409295-81a2-4cd4-892b-a790ab9c7532 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:26.958464 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-85409295-81a2-4cd4-892b-a790ab9c7532 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:26.960123 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-85409295-81a2-4cd4-892b-a790ab9c7532 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:26.961347 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-85409295-81a2-4cd4-892b-a790ab9c7532 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1730 microversion: 2.20 time: 0.295543 Aug 01 14:26:26.962126 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 425/840] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:26 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1730 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:27.171004 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c4a527c6-cf3f-423e-ae58-410ac3031093 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:27.180613 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c4a527c6-cf3f-423e-ae58-410ac3031093 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1756 microversion: 2.1 time: 0.266037 Aug 01 14:26:27.181510 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 416/841] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:26 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1756 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:26:27.858650 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-68a5eaf1-d8a0-4c49-8671-8a51ca9b2e38 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:27.860278 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-68a5eaf1-d8a0-4c49-8671-8a51ca9b2e38 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:27.868646 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-68a5eaf1-d8a0-4c49-8671-8a51ca9b2e38 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:27.869477 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-68a5eaf1-d8a0-4c49-8671-8a51ca9b2e38 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:27.870557 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-68a5eaf1-d8a0-4c49-8671-8a51ca9b2e38 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:27.871230 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-68a5eaf1-d8a0-4c49-8671-8a51ca9b2e38 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:27.992932 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-dcebc26b-4fc2-4ee8-807c-2e91963823f0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:27.995174 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-dcebc26b-4fc2-4ee8-807c-2e91963823f0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:28.007196 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dcebc26b-4fc2-4ee8-807c-2e91963823f0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:28.008428 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dcebc26b-4fc2-4ee8-807c-2e91963823f0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:28.010147 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dcebc26b-4fc2-4ee8-807c-2e91963823f0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:28.010951 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dcebc26b-4fc2-4ee8-807c-2e91963823f0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:28.024438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-68a5eaf1-d8a0-4c49-8671-8a51ca9b2e38 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:28.035493 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-68a5eaf1-d8a0-4c49-8671-8a51ca9b2e38 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1689 microversion: 2.1 time: 0.181371 Aug 01 14:26:28.050693 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 426/842] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:27 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1689 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:28.192396 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-dcebc26b-4fc2-4ee8-807c-2e91963823f0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:28.202148 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-dcebc26b-4fc2-4ee8-807c-2e91963823f0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:28.204267 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-dcebc26b-4fc2-4ee8-807c-2e91963823f0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:28.205480 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-dcebc26b-4fc2-4ee8-807c-2e91963823f0 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1730 microversion: 2.20 time: 0.219027 Aug 01 14:26:28.206068 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 417/843] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:27 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1730 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:26:28.212043 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6db5fdcf-42bb-4d7a-aeab-84c093a1fc03 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:28.213114 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-6db5fdcf-42bb-4d7a-aeab-84c093a1fc03 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:28.224786 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6db5fdcf-42bb-4d7a-aeab-84c093a1fc03 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:28.225569 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6db5fdcf-42bb-4d7a-aeab-84c093a1fc03 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:28.226967 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6db5fdcf-42bb-4d7a-aeab-84c093a1fc03 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:28.227755 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6db5fdcf-42bb-4d7a-aeab-84c093a1fc03 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:28.417599 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6db5fdcf-42bb-4d7a-aeab-84c093a1fc03 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:28.432122 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6db5fdcf-42bb-4d7a-aeab-84c093a1fc03 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1756 microversion: 2.1 time: 0.226448 Aug 01 14:26:28.433177 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 427/844] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:28 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1756 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:26:29.063347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a27f3283-5deb-47fc-86a0-c9efc560888a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:29.065812 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a27f3283-5deb-47fc-86a0-c9efc560888a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:29.079283 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a27f3283-5deb-47fc-86a0-c9efc560888a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:29.080776 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a27f3283-5deb-47fc-86a0-c9efc560888a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:29.092465 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a27f3283-5deb-47fc-86a0-c9efc560888a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:29.092465 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a27f3283-5deb-47fc-86a0-c9efc560888a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:29.244104 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f1374ce2-253f-41f8-83a6-4e200014240d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:29.245044 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f1374ce2-253f-41f8-83a6-4e200014240d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:29.253226 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f1374ce2-253f-41f8-83a6-4e200014240d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:29.253671 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f1374ce2-253f-41f8-83a6-4e200014240d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:29.254539 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f1374ce2-253f-41f8-83a6-4e200014240d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:29.255060 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f1374ce2-253f-41f8-83a6-4e200014240d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:29.287731 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a27f3283-5deb-47fc-86a0-c9efc560888a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:29.301119 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a27f3283-5deb-47fc-86a0-c9efc560888a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1689 microversion: 2.1 time: 0.245548 Aug 01 14:26:29.302276 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 418/845] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:29 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1689 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:29.447953 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f1374ce2-253f-41f8-83a6-4e200014240d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:29.457056 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f1374ce2-253f-41f8-83a6-4e200014240d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:29.458551 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f1374ce2-253f-41f8-83a6-4e200014240d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:29.459736 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f1374ce2-253f-41f8-83a6-4e200014240d tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1730 microversion: 2.20 time: 0.219586 Aug 01 14:26:29.460288 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 428/846] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:29 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1730 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:26:29.472145 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-aff143a2-84c8-40e1-b671-4e1ca89968e2 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:29.473290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-aff143a2-84c8-40e1-b671-4e1ca89968e2 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:29.484254 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aff143a2-84c8-40e1-b671-4e1ca89968e2 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:29.485072 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aff143a2-84c8-40e1-b671-4e1ca89968e2 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:29.486474 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aff143a2-84c8-40e1-b671-4e1ca89968e2 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:29.487264 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aff143a2-84c8-40e1-b671-4e1ca89968e2 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:29.686394 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-aff143a2-84c8-40e1-b671-4e1ca89968e2 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:29.695123 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-aff143a2-84c8-40e1-b671-4e1ca89968e2 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1756 microversion: 2.1 time: 0.230879 Aug 01 14:26:29.696038 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 419/847] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:29 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1756 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:30.339402 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-05f17e9d-5c22-4419-b9da-c4c97b244413 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:30.341095 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-05f17e9d-5c22-4419-b9da-c4c97b244413 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:30.349930 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05f17e9d-5c22-4419-b9da-c4c97b244413 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:30.350831 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05f17e9d-5c22-4419-b9da-c4c97b244413 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:30.352034 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05f17e9d-5c22-4419-b9da-c4c97b244413 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:30.352743 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-05f17e9d-5c22-4419-b9da-c4c97b244413 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:30.502205 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a17d0b7a-5856-48d3-905a-31a0e9897a37 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:30.503563 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a17d0b7a-5856-48d3-905a-31a0e9897a37 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:30.517870 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-05f17e9d-5c22-4419-b9da-c4c97b244413 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:30.530429 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a17d0b7a-5856-48d3-905a-31a0e9897a37 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:30.531106 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a17d0b7a-5856-48d3-905a-31a0e9897a37 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:30.532403 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a17d0b7a-5856-48d3-905a-31a0e9897a37 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:30.533019 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a17d0b7a-5856-48d3-905a-31a0e9897a37 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:30.541559 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-05f17e9d-5c22-4419-b9da-c4c97b244413 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1689 microversion: 2.1 time: 0.206803 Aug 01 14:26:30.555740 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 429/848] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:30 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1689 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:30.728961 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2a822391-6265-4493-ad88-98d508b5bbe3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:30.729806 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2a822391-6265-4493-ad88-98d508b5bbe3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:30.736345 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2a822391-6265-4493-ad88-98d508b5bbe3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:30.736793 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2a822391-6265-4493-ad88-98d508b5bbe3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:30.737562 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2a822391-6265-4493-ad88-98d508b5bbe3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:30.738000 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2a822391-6265-4493-ad88-98d508b5bbe3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:30.745831 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a17d0b7a-5856-48d3-905a-31a0e9897a37 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:30.757039 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a17d0b7a-5856-48d3-905a-31a0e9897a37 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:30.758602 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a17d0b7a-5856-48d3-905a-31a0e9897a37 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:30.759895 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a17d0b7a-5856-48d3-905a-31a0e9897a37 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1730 microversion: 2.20 time: 0.264882 Aug 01 14:26:30.775968 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 420/849] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:30 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1730 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:30.929563 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-2a822391-6265-4493-ad88-98d508b5bbe3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:30.950203 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2a822391-6265-4493-ad88-98d508b5bbe3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1756 microversion: 2.1 time: 0.224881 Aug 01 14:26:30.951412 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 430/850] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:30 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1756 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:26:31.574635 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-afb3754e-8800-41c2-ab10-e0594d32dc59 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:31.576562 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-afb3754e-8800-41c2-ab10-e0594d32dc59 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:31.585808 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-afb3754e-8800-41c2-ab10-e0594d32dc59 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:31.585808 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-afb3754e-8800-41c2-ab10-e0594d32dc59 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:31.585808 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-afb3754e-8800-41c2-ab10-e0594d32dc59 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:31.585808 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-afb3754e-8800-41c2-ab10-e0594d32dc59 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:31.747607 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-afb3754e-8800-41c2-ab10-e0594d32dc59 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:31.756582 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-afb3754e-8800-41c2-ab10-e0594d32dc59 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1689 microversion: 2.1 time: 0.186992 Aug 01 14:26:31.757181 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 421/851] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:31 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1689 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:31.790664 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-82f3b871-8ef8-44b8-a0ce-806e80af42f8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:31.800071 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-82f3b871-8ef8-44b8-a0ce-806e80af42f8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:31.804107 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-82f3b871-8ef8-44b8-a0ce-806e80af42f8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:31.805028 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-82f3b871-8ef8-44b8-a0ce-806e80af42f8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:31.806364 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-82f3b871-8ef8-44b8-a0ce-806e80af42f8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:31.807117 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-82f3b871-8ef8-44b8-a0ce-806e80af42f8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:31.978757 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-bdb9ddda-cff8-4ee8-ab16-a975368fed91 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:31.979596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-bdb9ddda-cff8-4ee8-ab16-a975368fed91 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:31.986828 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bdb9ddda-cff8-4ee8-ab16-a975368fed91 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:31.987351 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bdb9ddda-cff8-4ee8-ab16-a975368fed91 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:31.988487 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bdb9ddda-cff8-4ee8-ab16-a975368fed91 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:31.989214 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bdb9ddda-cff8-4ee8-ab16-a975368fed91 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:31.997746 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-82f3b871-8ef8-44b8-a0ce-806e80af42f8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:32.014847 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-82f3b871-8ef8-44b8-a0ce-806e80af42f8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:32.017919 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-82f3b871-8ef8-44b8-a0ce-806e80af42f8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:32.024810 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-82f3b871-8ef8-44b8-a0ce-806e80af42f8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1730 microversion: 2.20 time: 0.240912 Aug 01 14:26:32.025931 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 431/852] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:31 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1730 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:26:32.182254 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-bdb9ddda-cff8-4ee8-ab16-a975368fed91 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:32.197699 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-bdb9ddda-cff8-4ee8-ab16-a975368fed91 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1756 microversion: 2.1 time: 0.224089 Aug 01 14:26:32.198931 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 422/853] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:31 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1756 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:32.785577 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-548aa8e9-dd9a-493b-8f0c-1d0c7fe821d2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:32.787036 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-548aa8e9-dd9a-493b-8f0c-1d0c7fe821d2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:32.799551 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-548aa8e9-dd9a-493b-8f0c-1d0c7fe821d2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:32.801564 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-548aa8e9-dd9a-493b-8f0c-1d0c7fe821d2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:32.803168 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-548aa8e9-dd9a-493b-8f0c-1d0c7fe821d2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:32.804722 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-548aa8e9-dd9a-493b-8f0c-1d0c7fe821d2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:32.966124 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-548aa8e9-dd9a-493b-8f0c-1d0c7fe821d2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:32.974956 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-548aa8e9-dd9a-493b-8f0c-1d0c7fe821d2 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1689 microversion: 2.1 time: 0.197145 Aug 01 14:26:32.975741 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 432/854] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:32 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1689 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:33.050646 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-52ec5b53-0da7-4c16-919c-b82afa35ffa5 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:33.051211 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-52ec5b53-0da7-4c16-919c-b82afa35ffa5 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:33.058308 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-52ec5b53-0da7-4c16-919c-b82afa35ffa5 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:33.058754 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-52ec5b53-0da7-4c16-919c-b82afa35ffa5 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:33.059583 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-52ec5b53-0da7-4c16-919c-b82afa35ffa5 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:33.060015 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-52ec5b53-0da7-4c16-919c-b82afa35ffa5 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:33.206017 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-52ec5b53-0da7-4c16-919c-b82afa35ffa5 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:33.214290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-52ec5b53-0da7-4c16-919c-b82afa35ffa5 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:33.215838 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-52ec5b53-0da7-4c16-919c-b82afa35ffa5 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:33.217537 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-52ec5b53-0da7-4c16-919c-b82afa35ffa5 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1730 microversion: 2.20 time: 0.170503 Aug 01 14:26:33.218104 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 423/855] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:33 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:33.221414 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5fc30693-a323-4003-89ef-749597c5fbb2 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:33.222022 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5fc30693-a323-4003-89ef-749597c5fbb2 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:33.228539 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5fc30693-a323-4003-89ef-749597c5fbb2 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:33.229157 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5fc30693-a323-4003-89ef-749597c5fbb2 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:33.229986 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5fc30693-a323-4003-89ef-749597c5fbb2 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:33.230546 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5fc30693-a323-4003-89ef-749597c5fbb2 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:33.379355 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5fc30693-a323-4003-89ef-749597c5fbb2 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:33.388522 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5fc30693-a323-4003-89ef-749597c5fbb2 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1756 microversion: 2.1 time: 0.172185 Aug 01 14:26:33.389534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 433/856] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:33 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:26:33.998053 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-03bfef06-5436-4638-9ad8-669f41f585c9 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:33.999167 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-03bfef06-5436-4638-9ad8-669f41f585c9 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:34.005317 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-03bfef06-5436-4638-9ad8-669f41f585c9 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:34.005867 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-03bfef06-5436-4638-9ad8-669f41f585c9 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:34.006775 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-03bfef06-5436-4638-9ad8-669f41f585c9 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:34.007342 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-03bfef06-5436-4638-9ad8-669f41f585c9 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:34.143157 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-03bfef06-5436-4638-9ad8-669f41f585c9 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:34.151240 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-03bfef06-5436-4638-9ad8-669f41f585c9 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1689 microversion: 2.1 time: 0.157037 Aug 01 14:26:34.151960 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 424/857] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:33 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:34.240614 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8e612623-6d74-4ad3-897b-0bf5bf8f16a1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:34.241203 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-8e612623-6d74-4ad3-897b-0bf5bf8f16a1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:34.248041 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8e612623-6d74-4ad3-897b-0bf5bf8f16a1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:34.249149 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8e612623-6d74-4ad3-897b-0bf5bf8f16a1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:34.249868 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8e612623-6d74-4ad3-897b-0bf5bf8f16a1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:34.250302 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8e612623-6d74-4ad3-897b-0bf5bf8f16a1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:34.387324 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-8e612623-6d74-4ad3-897b-0bf5bf8f16a1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:34.395587 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-8e612623-6d74-4ad3-897b-0bf5bf8f16a1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:34.397086 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-8e612623-6d74-4ad3-897b-0bf5bf8f16a1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:34.398239 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8e612623-6d74-4ad3-897b-0bf5bf8f16a1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1730 microversion: 2.20 time: 0.161546 Aug 01 14:26:34.398801 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 434/858] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:34 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:34.411151 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5b402327-64cb-446d-b79c-7d2728312a83 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:34.411828 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5b402327-64cb-446d-b79c-7d2728312a83 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:34.418318 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5b402327-64cb-446d-b79c-7d2728312a83 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:34.418773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5b402327-64cb-446d-b79c-7d2728312a83 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:34.419585 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5b402327-64cb-446d-b79c-7d2728312a83 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:34.420710 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5b402327-64cb-446d-b79c-7d2728312a83 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:34.571313 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5b402327-64cb-446d-b79c-7d2728312a83 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:34.574789 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:34.582371 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5b402327-64cb-446d-b79c-7d2728312a83 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1756 microversion: 2.1 time: 0.175403 Aug 01 14:26:34.583030 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 425/859] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:34 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:35.173772 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b415ef37-20e5-40ce-9f91-71b961322bc3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:35.174295 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b415ef37-20e5-40ce-9f91-71b961322bc3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:35.181110 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b415ef37-20e5-40ce-9f91-71b961322bc3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:35.181713 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b415ef37-20e5-40ce-9f91-71b961322bc3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:35.182491 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b415ef37-20e5-40ce-9f91-71b961322bc3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:35.182928 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b415ef37-20e5-40ce-9f91-71b961322bc3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:35.325807 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b415ef37-20e5-40ce-9f91-71b961322bc3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:35.335925 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b415ef37-20e5-40ce-9f91-71b961322bc3 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1689 microversion: 2.1 time: 0.166047 Aug 01 14:26:35.336505 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 435/860] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:35 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:35.424147 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-875a6d68-6efa-4868-aa67-b639d6d71f19 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:35.424754 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-875a6d68-6efa-4868-aa67-b639d6d71f19 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:35.432270 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-875a6d68-6efa-4868-aa67-b639d6d71f19 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:35.432722 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-875a6d68-6efa-4868-aa67-b639d6d71f19 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:35.433488 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-875a6d68-6efa-4868-aa67-b639d6d71f19 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:35.433924 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-875a6d68-6efa-4868-aa67-b639d6d71f19 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:35.578470 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-875a6d68-6efa-4868-aa67-b639d6d71f19 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:35.586877 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-875a6d68-6efa-4868-aa67-b639d6d71f19 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:35.588421 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-875a6d68-6efa-4868-aa67-b639d6d71f19 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:35.589592 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-875a6d68-6efa-4868-aa67-b639d6d71f19 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1730 microversion: 2.20 time: 0.170657 Aug 01 14:26:35.590152 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 426/861] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:35 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:35.604612 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b0bb3107-0e20-4942-a34a-870a616c8739 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:35.605220 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b0bb3107-0e20-4942-a34a-870a616c8739 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:35.611542 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b0bb3107-0e20-4942-a34a-870a616c8739 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:35.611975 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b0bb3107-0e20-4942-a34a-870a616c8739 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:35.612785 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b0bb3107-0e20-4942-a34a-870a616c8739 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:35.613275 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b0bb3107-0e20-4942-a34a-870a616c8739 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:35.778694 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b0bb3107-0e20-4942-a34a-870a616c8739 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:35.786841 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b0bb3107-0e20-4942-a34a-870a616c8739 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1756 microversion: 2.1 time: 0.186300 Aug 01 14:26:35.787415 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 436/862] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:35 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:35.964637 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7b9cfce6-ad00-4b0a-980b-4d46e6d4b3a9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:35.965037 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7b9cfce6-ad00-4b0a-980b-4d46e6d4b3a9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: be8904b8-7a85-4d46-9dce-64e3503eaccf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:35.971987 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7b9cfce6-ad00-4b0a-980b-4d46e6d4b3a9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:35.972432 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7b9cfce6-ad00-4b0a-980b-4d46e6d4b3a9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:35.973187 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7b9cfce6-ad00-4b0a-980b-4d46e6d4b3a9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:35.973851 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7b9cfce6-ad00-4b0a-980b-4d46e6d4b3a9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:35.999167 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7b9cfce6-ad00-4b0a-980b-4d46e6d4b3a9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf/ips" status: 200 len: 149 microversion: 2.1 time: 0.038557 Aug 01 14:26:35.999776 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 427/863] 10.222.0.17 () {58 vars in 1248 bytes} [Mon Aug 1 14:26:35 2022] GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:26:36.357755 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c3b22f2c-8e0b-456b-9396-7c8b6f4e39d8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:36.358361 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c3b22f2c-8e0b-456b-9396-7c8b6f4e39d8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:36.365000 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c3b22f2c-8e0b-456b-9396-7c8b6f4e39d8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:36.365450 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c3b22f2c-8e0b-456b-9396-7c8b6f4e39d8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:36.366214 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c3b22f2c-8e0b-456b-9396-7c8b6f4e39d8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:36.366651 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c3b22f2c-8e0b-456b-9396-7c8b6f4e39d8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:36.381912 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=100 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:36.507628 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c3b22f2c-8e0b-456b-9396-7c8b6f4e39d8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:36.516109 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c3b22f2c-8e0b-456b-9396-7c8b6f4e39d8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1689 microversion: 2.1 time: 0.162381 Aug 01 14:26:36.516766 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 437/864] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:36 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:36.614005 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0aa926df-726b-4d3d-b4b1-6a7ec0d28869 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:36.614632 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0aa926df-726b-4d3d-b4b1-6a7ec0d28869 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:36.621489 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0aa926df-726b-4d3d-b4b1-6a7ec0d28869 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:36.621935 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0aa926df-726b-4d3d-b4b1-6a7ec0d28869 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:36.622706 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0aa926df-726b-4d3d-b4b1-6a7ec0d28869 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:36.623705 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0aa926df-726b-4d3d-b4b1-6a7ec0d28869 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:36.772662 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0aa926df-726b-4d3d-b4b1-6a7ec0d28869 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:36.782991 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0aa926df-726b-4d3d-b4b1-6a7ec0d28869 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:36.784592 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0aa926df-726b-4d3d-b4b1-6a7ec0d28869 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:36.785752 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0aa926df-726b-4d3d-b4b1-6a7ec0d28869 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1730 microversion: 2.20 time: 0.175984 Aug 01 14:26:36.786302 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 428/865] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:36 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:36.809456 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d9465728-16c1-403e-acc2-2ce254e300cb tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:36.810055 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d9465728-16c1-403e-acc2-2ce254e300cb tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:36.817332 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d9465728-16c1-403e-acc2-2ce254e300cb tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:36.817800 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d9465728-16c1-403e-acc2-2ce254e300cb tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:36.818556 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d9465728-16c1-403e-acc2-2ce254e300cb tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:36.818979 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d9465728-16c1-403e-acc2-2ce254e300cb tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:36.976162 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d9465728-16c1-403e-acc2-2ce254e300cb tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:36.984273 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d9465728-16c1-403e-acc2-2ce254e300cb tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1756 microversion: 2.1 time: 0.178631 Aug 01 14:26:36.984992 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 438/866] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:36 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:37.349062 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-fe5440d3-579f-45f9-acf7-56b741582ef9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f03d2b5-951c-47dd-b543-4d411d71dd5c"}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:26:37.352858 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-fe5440d3-579f-45f9-acf7-56b741582ef9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: be8904b8-7a85-4d46-9dce-64e3503eaccf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:37.362450 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fe5440d3-579f-45f9-acf7-56b741582ef9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:37.363115 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fe5440d3-579f-45f9-acf7-56b741582ef9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:37.364313 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fe5440d3-579f-45f9-acf7-56b741582ef9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:37.364959 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fe5440d3-579f-45f9-acf7-56b741582ef9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:37.538221 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8bc3e5a5-c775-4f55-935b-a486b4793531 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:37.538874 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-8bc3e5a5-c775-4f55-935b-a486b4793531 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:37.546771 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8bc3e5a5-c775-4f55-935b-a486b4793531 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:37.547287 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8bc3e5a5-c775-4f55-935b-a486b4793531 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:37.548105 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8bc3e5a5-c775-4f55-935b-a486b4793531 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:37.548660 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8bc3e5a5-c775-4f55-935b-a486b4793531 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:37.687694 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-8bc3e5a5-c775-4f55-935b-a486b4793531 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:37.695356 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8bc3e5a5-c775-4f55-935b-a486b4793531 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1689 microversion: 2.1 time: 0.161120 Aug 01 14:26:37.696009 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 439/867] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:37 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:26:37.808827 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-463b53c9-994b-4d90-9987-73e64c122c40 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:37.809433 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-463b53c9-994b-4d90-9987-73e64c122c40 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:37.815522 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-463b53c9-994b-4d90-9987-73e64c122c40 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:37.815973 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-463b53c9-994b-4d90-9987-73e64c122c40 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:37.816766 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-463b53c9-994b-4d90-9987-73e64c122c40 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:37.817223 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-463b53c9-994b-4d90-9987-73e64c122c40 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:37.963700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-463b53c9-994b-4d90-9987-73e64c122c40 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:37.972144 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-463b53c9-994b-4d90-9987-73e64c122c40 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:37.973636 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-463b53c9-994b-4d90-9987-73e64c122c40 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:37.974852 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-463b53c9-994b-4d90-9987-73e64c122c40 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1730 microversion: 2.20 time: 0.169914 Aug 01 14:26:37.975330 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 440/868] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:37 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:26:38.006799 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7561074c-aa31-4705-9f9c-f31fcaa89640 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:38.007401 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7561074c-aa31-4705-9f9c-f31fcaa89640 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:38.014014 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7561074c-aa31-4705-9f9c-f31fcaa89640 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:38.014458 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7561074c-aa31-4705-9f9c-f31fcaa89640 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:38.015210 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7561074c-aa31-4705-9f9c-f31fcaa89640 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:38.015673 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7561074c-aa31-4705-9f9c-f31fcaa89640 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:38.168083 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7561074c-aa31-4705-9f9c-f31fcaa89640 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:38.176247 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7561074c-aa31-4705-9f9c-f31fcaa89640 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1759 microversion: 2.1 time: 0.173741 Aug 01 14:26:38.176807 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 441/869] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:38 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1759 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:26:38.377666 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-fe5440d3-579f-45f9-acf7-56b741582ef9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "POST /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.035197 Aug 01 14:26:38.378600 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 429/870] 10.222.0.17 () {60 vars in 1323 bytes} [Mon Aug 1 14:26:37 2022] POST /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf/os-volume_attachments => generated 194 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:26:38.716783 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e48ee107-4c11-4b15-899b-df6f27295c7f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:38.717549 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e48ee107-4c11-4b15-899b-df6f27295c7f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:38.724948 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e48ee107-4c11-4b15-899b-df6f27295c7f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:38.725386 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e48ee107-4c11-4b15-899b-df6f27295c7f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:38.726146 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e48ee107-4c11-4b15-899b-df6f27295c7f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:38.726577 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e48ee107-4c11-4b15-899b-df6f27295c7f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:38.835860 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e48ee107-4c11-4b15-899b-df6f27295c7f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:38.846674 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e48ee107-4c11-4b15-899b-df6f27295c7f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 200 len: 1622 microversion: 2.1 time: 0.133736 Aug 01 14:26:38.848344 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 442/871] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:38 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 1622 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:39.001478 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5345237a-0897-4271-acbd-1c2789179867 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:39.002206 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5345237a-0897-4271-acbd-1c2789179867 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:39.008542 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5345237a-0897-4271-acbd-1c2789179867 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:39.008998 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5345237a-0897-4271-acbd-1c2789179867 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:39.009996 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5345237a-0897-4271-acbd-1c2789179867 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:39.010195 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5345237a-0897-4271-acbd-1c2789179867 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:39.152083 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-4756a183-105f-4ed0-89c3-4b17413a41f8 req-47e0bf75-fc56-40e6-ad46-103f0b2678fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5664fd60-279c-4671-9a77-a5bc99baf7be", "name": "network-vif-deleted", "tag": "2898c3ea-4ab0-4c5f-9813-8db5fcaa5a1d"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:26:39.184927 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5345237a-0897-4271-acbd-1c2789179867 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:39.189625 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-4756a183-105f-4ed0-89c3-4b17413a41f8 req-47e0bf75-fc56-40e6-ad46-103f0b2678fa service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:39.190409 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-4756a183-105f-4ed0-89c3-4b17413a41f8 req-47e0bf75-fc56-40e6-ad46-103f0b2678fa service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:39.193760 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5345237a-0897-4271-acbd-1c2789179867 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:39.195320 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5345237a-0897-4271-acbd-1c2789179867 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:39.197425 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5345237a-0897-4271-acbd-1c2789179867 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1730 microversion: 2.20 time: 0.201335 Aug 01 14:26:39.198180 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 430/872] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:38 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1730 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:39.231730 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-4756a183-105f-4ed0-89c3-4b17413a41f8 req-47e0bf75-fc56-40e6-ad46-103f0b2678fa service nova] Creating event network-vif-deleted:2898c3ea-4ab0-4c5f-9813-8db5fcaa5a1d for instance 5664fd60-279c-4671-9a77-a5bc99baf7be on hv-cinder-84599 Aug 01 14:26:39.246615 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-4756a183-105f-4ed0-89c3-4b17413a41f8 req-47e0bf75-fc56-40e6-ad46-103f0b2678fa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105527 Aug 01 14:26:39.248568 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 443/873] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:26:39.879618 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-920e215c-cd4b-4894-9e8e-9c454e65b06b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:39.880974 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-920e215c-cd4b-4894-9e8e-9c454e65b06b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 5664fd60-279c-4671-9a77-a5bc99baf7be] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:39.888038 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-920e215c-cd4b-4894-9e8e-9c454e65b06b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:39.888481 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-920e215c-cd4b-4894-9e8e-9c454e65b06b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:39.889473 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-920e215c-cd4b-4894-9e8e-9c454e65b06b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:39.889885 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-920e215c-cd4b-4894-9e8e-9c454e65b06b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:39.904952 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-920e215c-cd4b-4894-9e8e-9c454e65b06b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] HTTP exception thrown: Instance 5664fd60-279c-4671-9a77-a5bc99baf7be could not be found. Aug 01 14:26:39.906631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-920e215c-cd4b-4894-9e8e-9c454e65b06b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Request method failure captured: Aug 01 14:26:39.906631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be HTTP/1.1 Aug 01 14:26:39.906631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:26:39.906631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:26:39.906631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:26:39.906631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 0 Aug 01 14:26:39.906631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:26:39.906631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:26:39.906631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:26:39.906631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:26:39.906631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-F11vtUeswQDfyKUVNd6Q87sVfV5PCR7Xd2YFUfSTJWvW9H9BSU4X5lFb9W0uL4F8nItvzcQSbBv2rf9PJYyTBlLiQDJSVh8lDqem48k4DbhTBdctnFQI9X7sX_oT1CnuXpX_5VYrPdv-R-oZXqnj9WBTnSUyuTG5740iwyNCsCcJ0 Aug 01 14:26:39.906631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:26:39.906631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:26:39.906631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:26:39.906631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:26:39.906631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:26:39.906631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:26:39.906631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: 7b6f2af7de6b4e888e702c78f655448a Aug 01 14:26:39.906631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1825573094 Aug 01 14:26:39.906631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:26:39.906631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:26:39.908289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7b6f2af7de6b4e888e702c78f655448a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7b6f2af7de6b4e888e702c78f655448a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7b6f2af7de6b4e888e702c78f655448a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7b6f2af7de6b4e888e702c78f655448a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:26:39.908289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1825573094 Aug 01 14:26:39.908289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 7b6f2af7de6b4e888e702c78f655448a Aug 01 14:26:39.908289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1825573094 Aug 01 14:26:39.908289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-ServerRescueNegativeTestJSON-1825573094-project Aug 01 14:26:39.908289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:26:39.908289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:26:39.908289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: c487e443eb274090bce842e855b015ec Aug 01 14:26:39.908289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1825573094-project Aug 01 14:26:39.908289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: > Aug 01 14:26:39.908289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Instance 5664fd60-279c-4671-9a77-a5bc99baf7be could not be found. Aug 01 14:26:39.908289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'id': '5664fd60-279c-4671-9a77-a5bc99baf7be'} Aug 01 14:26:39.909214 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:26:39.909214 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:39.909214 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:26:39.909214 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:26:39.909214 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:26:39.909214 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:26:39.909214 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:26:39.909214 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:26:39.909214 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:26:39.909214 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:26:39.909214 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5664fd60-279c-4671-9a77-a5bc99baf7be could not be found. Aug 01 14:26:39.909214 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:26:39.909214 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:39.909214 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:26:39.909214 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:39.909214 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:39.909214 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:39.909214 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:26:39.909214 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:26:39.909214 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:26:39.910551 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:26:39.910551 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:26:39.910551 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:26:39.910551 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:26:39.910551 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:26:39.910551 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:26:39.910551 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:26:39.910551 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5664fd60-279c-4671-9a77-a5bc99baf7be could not be found. Aug 01 14:26:39.910551 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:26:39.910551 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:39.910551 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:26:39.910551 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:39.910551 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:39.910551 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:39.910551 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:26:39.910551 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:26:39.910551 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5664fd60-279c-4671-9a77-a5bc99baf7be could not be found. Aug 01 14:26:39.910551 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:26:39.911833 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-920e215c-cd4b-4894-9e8e-9c454e65b06b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Returning 404 to user: Instance 5664fd60-279c-4671-9a77-a5bc99baf7be could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:26:39.911833 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-920e215c-cd4b-4894-9e8e-9c454e65b06b tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be" status: 404 len: 111 microversion: 2.1 time: 0.032421 Aug 01 14:26:39.911833 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 431/874] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:39 2022] GET /compute/v2.1/servers/5664fd60-279c-4671-9a77-a5bc99baf7be => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:26:39.918539 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9a449a40-bb21-4748-8519-1c432683370e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '.version_select at 0x7f6189d79a60>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:39.942761 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9a449a40-bb21-4748-8519-1c432683370e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1304209833" status: 202 len: 0 microversion: 2.1 time: 0.028485 Aug 01 14:26:39.943854 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 444/875] 10.222.0.17 () {58 vars in 1221 bytes} [Mon Aug 1 14:26:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1304209833 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:26:40.241726 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-32ff6f34-b6e7-46b0-bd49-70307248e069 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:40.243199 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-32ff6f34-b6e7-46b0-bd49-70307248e069 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:40.255253 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-32ff6f34-b6e7-46b0-bd49-70307248e069 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:40.256324 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-32ff6f34-b6e7-46b0-bd49-70307248e069 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:40.257682 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-32ff6f34-b6e7-46b0-bd49-70307248e069 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:40.258433 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-32ff6f34-b6e7-46b0-bd49-70307248e069 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:40.463305 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-32ff6f34-b6e7-46b0-bd49-70307248e069 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:40.484136 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-32ff6f34-b6e7-46b0-bd49-70307248e069 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:40.488059 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-32ff6f34-b6e7-46b0-bd49-70307248e069 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:40.490782 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-32ff6f34-b6e7-46b0-bd49-70307248e069 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1730 microversion: 2.20 time: 0.256407 Aug 01 14:26:40.507583 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 432/876] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:40 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1730 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:41.526486 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d4109cb9-59ae-4563-99a4-8ae60a3041b8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:41.527206 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d4109cb9-59ae-4563-99a4-8ae60a3041b8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:41.534587 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d4109cb9-59ae-4563-99a4-8ae60a3041b8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:41.535039 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d4109cb9-59ae-4563-99a4-8ae60a3041b8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:41.535837 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d4109cb9-59ae-4563-99a4-8ae60a3041b8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:41.536272 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d4109cb9-59ae-4563-99a4-8ae60a3041b8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:41.695343 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d4109cb9-59ae-4563-99a4-8ae60a3041b8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:41.704078 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d4109cb9-59ae-4563-99a4-8ae60a3041b8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:41.705579 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d4109cb9-59ae-4563-99a4-8ae60a3041b8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:41.706747 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d4109cb9-59ae-4563-99a4-8ae60a3041b8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1730 microversion: 2.20 time: 0.184308 Aug 01 14:26:41.707305 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 445/877] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:41 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:42.651900 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-f02684c5-803e-4521-9eb7-e622e7738a0b req-acbc5b80-a9e8-4abe-9a27-8d6dca0b0a00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40a79ecf-b103-42e0-9cd6-d1daacb03f53", "name": "network-vif-plugged", "status": "completed", "tag": "0379a8d6-df19-44b8-a731-76a7821a7444"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:26:42.665134 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-f02684c5-803e-4521-9eb7-e622e7738a0b req-acbc5b80-a9e8-4abe-9a27-8d6dca0b0a00 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:42.666084 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-f02684c5-803e-4521-9eb7-e622e7738a0b req-acbc5b80-a9e8-4abe-9a27-8d6dca0b0a00 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:42.682126 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-f02684c5-803e-4521-9eb7-e622e7738a0b req-acbc5b80-a9e8-4abe-9a27-8d6dca0b0a00 service nova] Creating event network-vif-plugged:0379a8d6-df19-44b8-a731-76a7821a7444 for instance 40a79ecf-b103-42e0-9cd6-d1daacb03f53 on hv-cinder-84599 Aug 01 14:26:42.687826 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-f02684c5-803e-4521-9eb7-e622e7738a0b req-acbc5b80-a9e8-4abe-9a27-8d6dca0b0a00 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039879 Aug 01 14:26:42.688623 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 433/878] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:26:42.730424 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-549c0e5c-21cc-40b9-be08-35e4253911d7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:42.731038 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-549c0e5c-21cc-40b9-be08-35e4253911d7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:42.740149 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-549c0e5c-21cc-40b9-be08-35e4253911d7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:42.740939 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-549c0e5c-21cc-40b9-be08-35e4253911d7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:42.750616 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-549c0e5c-21cc-40b9-be08-35e4253911d7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:42.751214 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-549c0e5c-21cc-40b9-be08-35e4253911d7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:42.930688 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-549c0e5c-21cc-40b9-be08-35e4253911d7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:42.942489 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-549c0e5c-21cc-40b9-be08-35e4253911d7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:42.944032 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-549c0e5c-21cc-40b9-be08-35e4253911d7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:42.945205 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-549c0e5c-21cc-40b9-be08-35e4253911d7 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1730 microversion: 2.20 time: 0.219001 Aug 01 14:26:42.945764 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 446/879] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:42 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1730 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:43.038986 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5173d90e-5780-48ea-af63-08627984f44d tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:43.039903 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5173d90e-5780-48ea-af63-08627984f44d tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:43.050717 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5173d90e-5780-48ea-af63-08627984f44d tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:43.051597 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5173d90e-5780-48ea-af63-08627984f44d tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:43.052924 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5173d90e-5780-48ea-af63-08627984f44d tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:43.053484 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5173d90e-5780-48ea-af63-08627984f44d tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:43.088931 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5173d90e-5780-48ea-af63-08627984f44d tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Going to try to terminate instance {{(pid=118133) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:26:43.189003 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5173d90e-5780-48ea-af63-08627984f44d tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 204 len: 0 microversion: 2.1 time: 0.155478 Aug 01 14:26:43.189589 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 434/880] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Aug 1 14:26:43 2022] DELETE /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 14:26:43.197988 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-62a18054-203a-4a07-a696-8d752c29314f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:43.198601 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-62a18054-203a-4a07-a696-8d752c29314f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:43.206740 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-62a18054-203a-4a07-a696-8d752c29314f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:43.207214 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-62a18054-203a-4a07-a696-8d752c29314f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:43.209422 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-62a18054-203a-4a07-a696-8d752c29314f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:43.209865 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-62a18054-203a-4a07-a696-8d752c29314f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:43.496576 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-62a18054-203a-4a07-a696-8d752c29314f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:43.505016 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-62a18054-203a-4a07-a696-8d752c29314f tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1508 microversion: 2.1 time: 0.310822 Aug 01 14:26:43.505716 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 447/881] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:43 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1508 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:43.971144 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3f95be5b-fd3e-475f-bfd5-7903af0346f2 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:43.971927 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3f95be5b-fd3e-475f-bfd5-7903af0346f2 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:43.978596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3f95be5b-fd3e-475f-bfd5-7903af0346f2 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:43.979036 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3f95be5b-fd3e-475f-bfd5-7903af0346f2 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:43.979825 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3f95be5b-fd3e-475f-bfd5-7903af0346f2 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:43.980263 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3f95be5b-fd3e-475f-bfd5-7903af0346f2 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:44.116534 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3f95be5b-fd3e-475f-bfd5-7903af0346f2 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:44.125260 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3f95be5b-fd3e-475f-bfd5-7903af0346f2 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:44.126754 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3f95be5b-fd3e-475f-bfd5-7903af0346f2 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:44.127960 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3f95be5b-fd3e-475f-bfd5-7903af0346f2 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1730 microversion: 2.20 time: 0.161542 Aug 01 14:26:44.128521 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 435/882] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:43 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:44.527050 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5053433e-066e-4909-858d-b26c1223414a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:44.527691 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5053433e-066e-4909-858d-b26c1223414a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:44.534423 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5053433e-066e-4909-858d-b26c1223414a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:44.534867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5053433e-066e-4909-858d-b26c1223414a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:44.535663 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5053433e-066e-4909-858d-b26c1223414a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:44.536087 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5053433e-066e-4909-858d-b26c1223414a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:44.678877 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5053433e-066e-4909-858d-b26c1223414a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:44.687201 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5053433e-066e-4909-858d-b26c1223414a tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1508 microversion: 2.1 time: 0.164235 Aug 01 14:26:44.687798 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 448/883] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:44 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:45.150615 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d456dda0-d174-4a5d-a319-fa574ae0c8b1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:45.151172 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d456dda0-d174-4a5d-a319-fa574ae0c8b1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:45.158416 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d456dda0-d174-4a5d-a319-fa574ae0c8b1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:45.158858 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d456dda0-d174-4a5d-a319-fa574ae0c8b1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:45.159797 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d456dda0-d174-4a5d-a319-fa574ae0c8b1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:45.160235 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d456dda0-d174-4a5d-a319-fa574ae0c8b1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:45.299199 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d456dda0-d174-4a5d-a319-fa574ae0c8b1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:45.307723 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d456dda0-d174-4a5d-a319-fa574ae0c8b1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:45.309251 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d456dda0-d174-4a5d-a319-fa574ae0c8b1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:45.311045 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d456dda0-d174-4a5d-a319-fa574ae0c8b1 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1730 microversion: 2.20 time: 0.163893 Aug 01 14:26:45.311643 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 436/884] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:45 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:45.708674 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-dd539d5f-fc2e-43a2-926b-6dc43d11d7c8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:45.709329 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-dd539d5f-fc2e-43a2-926b-6dc43d11d7c8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:45.716209 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dd539d5f-fc2e-43a2-926b-6dc43d11d7c8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:45.717365 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dd539d5f-fc2e-43a2-926b-6dc43d11d7c8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:45.717988 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dd539d5f-fc2e-43a2-926b-6dc43d11d7c8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:45.718414 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dd539d5f-fc2e-43a2-926b-6dc43d11d7c8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:45.860107 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-dd539d5f-fc2e-43a2-926b-6dc43d11d7c8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:45.868870 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-dd539d5f-fc2e-43a2-926b-6dc43d11d7c8 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1508 microversion: 2.1 time: 0.164026 Aug 01 14:26:45.869548 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 449/885] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:45 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:46.335567 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e9737d32-3805-4f6a-ab75-cdac382d2b5a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:46.336180 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e9737d32-3805-4f6a-ab75-cdac382d2b5a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:46.342791 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e9737d32-3805-4f6a-ab75-cdac382d2b5a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:46.343233 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e9737d32-3805-4f6a-ab75-cdac382d2b5a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:46.344365 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e9737d32-3805-4f6a-ab75-cdac382d2b5a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:46.344798 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e9737d32-3805-4f6a-ab75-cdac382d2b5a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:46.494021 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e9737d32-3805-4f6a-ab75-cdac382d2b5a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:46.502917 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e9737d32-3805-4f6a-ab75-cdac382d2b5a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:46.504689 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e9737d32-3805-4f6a-ab75-cdac382d2b5a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:46.505882 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e9737d32-3805-4f6a-ab75-cdac382d2b5a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1730 microversion: 2.20 time: 0.175295 Aug 01 14:26:46.511529 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 437/886] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:46 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:46.893106 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-38b56632-a1b8-4a25-9b25-327b9a4453a7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:46.895189 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-38b56632-a1b8-4a25-9b25-327b9a4453a7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:46.901948 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:46.904420 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-38b56632-a1b8-4a25-9b25-327b9a4453a7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:46.905089 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-38b56632-a1b8-4a25-9b25-327b9a4453a7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:46.906428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-38b56632-a1b8-4a25-9b25-327b9a4453a7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:46.907123 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-38b56632-a1b8-4a25-9b25-327b9a4453a7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:47.055703 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-38b56632-a1b8-4a25-9b25-327b9a4453a7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:47.067756 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-38b56632-a1b8-4a25-9b25-327b9a4453a7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 200 len: 1466 microversion: 2.1 time: 0.181248 Aug 01 14:26:47.083367 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 450/887] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:46 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 1466 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:47.118478 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-d0bbf20e-68fe-4ac2-a631-ff3dea88bca4 req-eece7fe8-030b-4e01-9bd4-111f2a4523c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d", "name": "network-vif-deleted", "tag": "e72e4e9c-0136-4f4f-a7e1-0f7843f8ac00"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:26:47.124422 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:47.131115 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-d0bbf20e-68fe-4ac2-a631-ff3dea88bca4 req-eece7fe8-030b-4e01-9bd4-111f2a4523c2 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:47.131676 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-d0bbf20e-68fe-4ac2-a631-ff3dea88bca4 req-eece7fe8-030b-4e01-9bd4-111f2a4523c2 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:47.145016 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-d0bbf20e-68fe-4ac2-a631-ff3dea88bca4 req-eece7fe8-030b-4e01-9bd4-111f2a4523c2 service nova] Creating event network-vif-deleted:e72e4e9c-0136-4f4f-a7e1-0f7843f8ac00 for instance 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d on hv-cinder-84599 Aug 01 14:26:47.150272 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-d0bbf20e-68fe-4ac2-a631-ff3dea88bca4 req-eece7fe8-030b-4e01-9bd4-111f2a4523c2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036765 Aug 01 14:26:47.150976 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 438/888] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:26:47.537182 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-95d348ff-08ab-4ecd-b8ac-d210672068a8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:47.538241 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-95d348ff-08ab-4ecd-b8ac-d210672068a8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:47.549990 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-95d348ff-08ab-4ecd-b8ac-d210672068a8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:47.551147 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-95d348ff-08ab-4ecd-b8ac-d210672068a8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:47.552648 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-95d348ff-08ab-4ecd-b8ac-d210672068a8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:47.553664 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-95d348ff-08ab-4ecd-b8ac-d210672068a8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:47.713475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-95d348ff-08ab-4ecd-b8ac-d210672068a8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:47.722265 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-95d348ff-08ab-4ecd-b8ac-d210672068a8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:47.723798 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-95d348ff-08ab-4ecd-b8ac-d210672068a8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:47.724970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-95d348ff-08ab-4ecd-b8ac-d210672068a8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1717 microversion: 2.20 time: 0.193756 Aug 01 14:26:47.725536 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 451/889] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:47 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1717 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:48.090887 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5eae097a-921c-40dc-81bf-bd379e056d11 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:48.092022 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5eae097a-921c-40dc-81bf-bd379e056d11 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:48.099085 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5eae097a-921c-40dc-81bf-bd379e056d11 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:48.099566 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5eae097a-921c-40dc-81bf-bd379e056d11 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:48.100363 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5eae097a-921c-40dc-81bf-bd379e056d11 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:48.100808 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5eae097a-921c-40dc-81bf-bd379e056d11 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:48.121592 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-5eae097a-921c-40dc-81bf-bd379e056d11 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] HTTP exception thrown: Instance 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d could not be found. Aug 01 14:26:48.124177 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5eae097a-921c-40dc-81bf-bd379e056d11 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Request method failure captured: Aug 01 14:26:48.124177 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d HTTP/1.1 Aug 01 14:26:48.124177 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:26:48.124177 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:26:48.124177 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:26:48.124177 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 0 Aug 01 14:26:48.124177 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:26:48.124177 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:26:48.124177 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:26:48.124177 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:26:48.124177 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-F11vtUeswQDfyKUVNd6Q87sVfV5PCR7Xd2YFUfSTJWvW9H9BSU4X5lFb9W0uL4F8nItvzcQSbBv2rf9PJYyTBlLiQDJSVh8lDqem48k4DbhTBdctnFQI9X7sX_oT1CnuXpX_5VYrPdv-R-oZXqnj9WBTnSUyuTG5740iwyNCsCcJ0 Aug 01 14:26:48.124177 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:26:48.124177 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:26:48.124177 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:26:48.124177 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:26:48.124177 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:26:48.124177 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:26:48.124177 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: 7b6f2af7de6b4e888e702c78f655448a Aug 01 14:26:48.124177 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1825573094 Aug 01 14:26:48.124177 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:26:48.124177 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:26:48.127036 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7b6f2af7de6b4e888e702c78f655448a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7b6f2af7de6b4e888e702c78f655448a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7b6f2af7de6b4e888e702c78f655448a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7b6f2af7de6b4e888e702c78f655448a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:26:48.127036 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1825573094 Aug 01 14:26:48.127036 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 7b6f2af7de6b4e888e702c78f655448a Aug 01 14:26:48.127036 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1825573094 Aug 01 14:26:48.127036 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-ServerRescueNegativeTestJSON-1825573094-project Aug 01 14:26:48.127036 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:26:48.127036 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:26:48.127036 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: c487e443eb274090bce842e855b015ec Aug 01 14:26:48.127036 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1825573094-project Aug 01 14:26:48.127036 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: > Aug 01 14:26:48.127036 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Instance 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d could not be found. Aug 01 14:26:48.127036 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'id': '2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d'} Aug 01 14:26:48.128103 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:26:48.128103 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:48.128103 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:26:48.128103 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:26:48.128103 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:26:48.128103 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:26:48.128103 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:26:48.128103 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:26:48.128103 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:26:48.128103 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:26:48.128103 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d could not be found. Aug 01 14:26:48.128103 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:26:48.128103 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:48.128103 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:26:48.128103 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:48.128103 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:48.128103 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:48.128103 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:26:48.128103 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:26:48.128103 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:26:48.130955 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:26:48.130955 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:26:48.130955 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:26:48.130955 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:26:48.130955 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:26:48.130955 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:26:48.130955 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:26:48.130955 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d could not be found. Aug 01 14:26:48.130955 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:26:48.130955 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:48.130955 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:26:48.130955 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:48.130955 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:48.130955 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:48.130955 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:26:48.130955 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:26:48.130955 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d could not be found. Aug 01 14:26:48.130955 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:26:48.132979 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5eae097a-921c-40dc-81bf-bd379e056d11 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Returning 404 to user: Instance 2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:26:48.132979 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5eae097a-921c-40dc-81bf-bd379e056d11 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d" status: 404 len: 111 microversion: 2.1 time: 0.039969 Aug 01 14:26:48.132979 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 439/890] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:48 2022] GET /compute/v2.1/servers/2c43e89c-63a3-4c0b-b0aa-8cbd89ac081d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:26:48.137482 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0d6d2503-47ca-422d-929f-5a1225aa8fb5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:48.138031 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0d6d2503-47ca-422d-929f-5a1225aa8fb5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:48.146623 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0d6d2503-47ca-422d-929f-5a1225aa8fb5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:48.147240 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0d6d2503-47ca-422d-929f-5a1225aa8fb5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:48.148241 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0d6d2503-47ca-422d-929f-5a1225aa8fb5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:48.148828 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0d6d2503-47ca-422d-929f-5a1225aa8fb5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:48.177675 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0d6d2503-47ca-422d-929f-5a1225aa8fb5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Going to try to terminate instance {{(pid=118132) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:26:48.275060 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0d6d2503-47ca-422d-929f-5a1225aa8fb5 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 204 len: 0 microversion: 2.1 time: 0.141729 Aug 01 14:26:48.276064 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 452/891] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Aug 1 14:26:48 2022] DELETE /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:26:48.289147 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5abaa842-d550-487b-b083-57d5156cd33e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:48.290178 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5abaa842-d550-487b-b083-57d5156cd33e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:48.302861 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5abaa842-d550-487b-b083-57d5156cd33e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:48.303715 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5abaa842-d550-487b-b083-57d5156cd33e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:48.304997 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5abaa842-d550-487b-b083-57d5156cd33e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:48.305708 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5abaa842-d550-487b-b083-57d5156cd33e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:48.395547 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-876cdc21-6594-46db-acbd-194f7acb3ac9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:48.396411 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-876cdc21-6594-46db-acbd-194f7acb3ac9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: be8904b8-7a85-4d46-9dce-64e3503eaccf] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:48.402555 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-876cdc21-6594-46db-acbd-194f7acb3ac9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:48.403002 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-876cdc21-6594-46db-acbd-194f7acb3ac9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:48.404705 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-876cdc21-6594-46db-acbd-194f7acb3ac9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:48.405228 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-876cdc21-6594-46db-acbd-194f7acb3ac9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:48.451988 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5abaa842-d550-487b-b083-57d5156cd33e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:48.460387 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5abaa842-d550-487b-b083-57d5156cd33e tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.177661 Aug 01 14:26:48.461148 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 440/892] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:48 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:48.494250 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-876cdc21-6594-46db-acbd-194f7acb3ac9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lazy-loading 'services' on Instance uuid be8904b8-7a85-4d46-9dce-64e3503eaccf {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:26:48.496612 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:48.570604 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-876cdc21-6594-46db-acbd-194f7acb3ac9 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "DELETE /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf/os-volume_attachments/8f03d2b5-951c-47dd-b543-4d411d71dd5c" status: 202 len: 0 microversion: 2.1 time: 0.179343 Aug 01 14:26:48.571279 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 453/893] 10.222.0.17 () {58 vars in 1416 bytes} [Mon Aug 1 14:26:48 2022] DELETE /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf/os-volume_attachments/8f03d2b5-951c-47dd-b543-4d411d71dd5c => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:26:48.580408 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-483f4c61-d7df-4400-ad70-c9237848b311 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:48.582683 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-483f4c61-d7df-4400-ad70-c9237848b311 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: be8904b8-7a85-4d46-9dce-64e3503eaccf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:48.589007 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-483f4c61-d7df-4400-ad70-c9237848b311 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:48.589454 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-483f4c61-d7df-4400-ad70-c9237848b311 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:48.590246 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-483f4c61-d7df-4400-ad70-c9237848b311 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:48.590678 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-483f4c61-d7df-4400-ad70-c9237848b311 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:48.622493 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-483f4c61-d7df-4400-ad70-c9237848b311 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046588 Aug 01 14:26:48.623475 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 441/894] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Aug 1 14:26:48 2022] GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:26:49.483387 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8e5ae539-e421-43e8-a19d-6a200a30fcba tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:49.484191 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-8e5ae539-e421-43e8-a19d-6a200a30fcba tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:49.490596 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8e5ae539-e421-43e8-a19d-6a200a30fcba tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:49.491039 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8e5ae539-e421-43e8-a19d-6a200a30fcba tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:49.491850 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8e5ae539-e421-43e8-a19d-6a200a30fcba tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:49.492287 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8e5ae539-e421-43e8-a19d-6a200a30fcba tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:49.627437 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-8e5ae539-e421-43e8-a19d-6a200a30fcba tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:49.635208 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8e5ae539-e421-43e8-a19d-6a200a30fcba tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.156560 Aug 01 14:26:49.635713 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7d09ac3d-31e2-44d9-bd53-dbab53d347a0 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:49.636215 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 454/895] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:49 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:49.637979 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7d09ac3d-31e2-44d9-bd53-dbab53d347a0 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: be8904b8-7a85-4d46-9dce-64e3503eaccf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:49.645736 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7d09ac3d-31e2-44d9-bd53-dbab53d347a0 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:49.646307 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7d09ac3d-31e2-44d9-bd53-dbab53d347a0 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:49.647283 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7d09ac3d-31e2-44d9-bd53-dbab53d347a0 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:49.647804 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7d09ac3d-31e2-44d9-bd53-dbab53d347a0 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:49.666382 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:49.681846 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7d09ac3d-31e2-44d9-bd53-dbab53d347a0 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050213 Aug 01 14:26:49.682411 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 442/896] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Aug 1 14:26:49 2022] GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:26:50.657272 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a64c1296-e2bb-4c3e-9744-417559443be6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:50.657898 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a64c1296-e2bb-4c3e-9744-417559443be6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:50.664993 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a64c1296-e2bb-4c3e-9744-417559443be6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:50.665448 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a64c1296-e2bb-4c3e-9744-417559443be6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:50.666221 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a64c1296-e2bb-4c3e-9744-417559443be6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:50.666655 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a64c1296-e2bb-4c3e-9744-417559443be6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:50.694501 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7964283e-27b8-4d72-92d7-fa07d3bb1d4a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:50.696713 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7964283e-27b8-4d72-92d7-fa07d3bb1d4a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: be8904b8-7a85-4d46-9dce-64e3503eaccf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:50.703994 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7964283e-27b8-4d72-92d7-fa07d3bb1d4a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:50.704500 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7964283e-27b8-4d72-92d7-fa07d3bb1d4a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:50.705211 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7964283e-27b8-4d72-92d7-fa07d3bb1d4a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:50.705637 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7964283e-27b8-4d72-92d7-fa07d3bb1d4a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:50.735862 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7964283e-27b8-4d72-92d7-fa07d3bb1d4a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045276 Aug 01 14:26:50.736698 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 443/897] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Aug 1 14:26:50 2022] GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:26:50.799031 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a64c1296-e2bb-4c3e-9744-417559443be6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:50.806717 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a64c1296-e2bb-4c3e-9744-417559443be6 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.153459 Aug 01 14:26:50.807277 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 455/898] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:50 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:51.747783 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-758d6d7a-01b9-4ed2-8e08-441ffb84fa35 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:51.749934 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-758d6d7a-01b9-4ed2-8e08-441ffb84fa35 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: be8904b8-7a85-4d46-9dce-64e3503eaccf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:51.756999 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-758d6d7a-01b9-4ed2-8e08-441ffb84fa35 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:51.757437 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-758d6d7a-01b9-4ed2-8e08-441ffb84fa35 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:51.758202 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-758d6d7a-01b9-4ed2-8e08-441ffb84fa35 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:51.758633 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-758d6d7a-01b9-4ed2-8e08-441ffb84fa35 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:51.790430 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-758d6d7a-01b9-4ed2-8e08-441ffb84fa35 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046622 Aug 01 14:26:51.790997 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 444/899] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Aug 1 14:26:51 2022] GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:26:51.828728 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-36165c10-2307-4dd5-85e5-523d40a165f7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:51.829319 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-36165c10-2307-4dd5-85e5-523d40a165f7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:51.836045 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-36165c10-2307-4dd5-85e5-523d40a165f7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:51.836495 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-36165c10-2307-4dd5-85e5-523d40a165f7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:51.837264 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-36165c10-2307-4dd5-85e5-523d40a165f7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:51.837704 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-36165c10-2307-4dd5-85e5-523d40a165f7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:51.975882 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-36165c10-2307-4dd5-85e5-523d40a165f7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:51.985221 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-36165c10-2307-4dd5-85e5-523d40a165f7 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1522 microversion: 2.1 time: 0.161088 Aug 01 14:26:51.985800 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 456/900] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:51 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:52.565011 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-53b396c6-ed05-4f7a-8e42-a417ff76e91b req-cf7ccb9f-67db-47ec-ad2c-647435e648a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2775d75f-b4fd-451b-bba5-471868aafc29", "name": "network-vif-deleted", "tag": "73f3ff55-6acb-4e37-8c00-8a5a4f09a5d7"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:26:52.574769 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-53b396c6-ed05-4f7a-8e42-a417ff76e91b req-cf7ccb9f-67db-47ec-ad2c-647435e648a3 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:52.575203 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-53b396c6-ed05-4f7a-8e42-a417ff76e91b req-cf7ccb9f-67db-47ec-ad2c-647435e648a3 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:52.588351 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-53b396c6-ed05-4f7a-8e42-a417ff76e91b req-cf7ccb9f-67db-47ec-ad2c-647435e648a3 service nova] Creating event network-vif-deleted:73f3ff55-6acb-4e37-8c00-8a5a4f09a5d7 for instance 2775d75f-b4fd-451b-bba5-471868aafc29 on hv-cinder-84599 Aug 01 14:26:52.594248 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-53b396c6-ed05-4f7a-8e42-a417ff76e91b req-cf7ccb9f-67db-47ec-ad2c-647435e648a3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032942 Aug 01 14:26:52.595065 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 445/901] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:26:52.802533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f44e65a4-5bc6-4c7a-974d-3a1c246e6391 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:52.804783 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f44e65a4-5bc6-4c7a-974d-3a1c246e6391 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: be8904b8-7a85-4d46-9dce-64e3503eaccf] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:52.811750 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f44e65a4-5bc6-4c7a-974d-3a1c246e6391 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:52.812148 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f44e65a4-5bc6-4c7a-974d-3a1c246e6391 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:52.812969 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f44e65a4-5bc6-4c7a-974d-3a1c246e6391 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:52.813400 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f44e65a4-5bc6-4c7a-974d-3a1c246e6391 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:52.848234 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f44e65a4-5bc6-4c7a-974d-3a1c246e6391 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049707 Aug 01 14:26:52.848853 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 457/902] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Aug 1 14:26:52 2022] GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:26:52.933265 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-01b89a2e-473d-43bc-aa13-f24b4c944fba tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:52.933896 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-01b89a2e-473d-43bc-aa13-f24b4c944fba tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: be8904b8-7a85-4d46-9dce-64e3503eaccf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:52.943290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-01b89a2e-473d-43bc-aa13-f24b4c944fba tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:52.943982 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-01b89a2e-473d-43bc-aa13-f24b4c944fba tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:52.944920 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-01b89a2e-473d-43bc-aa13-f24b4c944fba tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:52.945533 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-01b89a2e-473d-43bc-aa13-f24b4c944fba tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:52.980497 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-01b89a2e-473d-43bc-aa13-f24b4c944fba tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: be8904b8-7a85-4d46-9dce-64e3503eaccf] Going to try to terminate instance {{(pid=118133) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:26:53.006502 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7660f38d-ae17-4e02-b3a6-45bb798d4709 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:53.007121 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7660f38d-ae17-4e02-b3a6-45bb798d4709 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:53.014491 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7660f38d-ae17-4e02-b3a6-45bb798d4709 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:53.014937 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7660f38d-ae17-4e02-b3a6-45bb798d4709 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:53.015743 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7660f38d-ae17-4e02-b3a6-45bb798d4709 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:53.016266 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7660f38d-ae17-4e02-b3a6-45bb798d4709 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:53.069990 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7660f38d-ae17-4e02-b3a6-45bb798d4709 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:53.070612 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7660f38d-ae17-4e02-b3a6-45bb798d4709 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:53.071363 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-7660f38d-ae17-4e02-b3a6-45bb798d4709 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lazy-loading 'fault' on Instance uuid 2775d75f-b4fd-451b-bba5-471868aafc29 {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:26:53.102262 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-01b89a2e-473d-43bc-aa13-f24b4c944fba tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "DELETE /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf" status: 204 len: 0 microversion: 2.1 time: 0.173235 Aug 01 14:26:53.103250 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 446/903] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Aug 1 14:26:52 2022] DELETE /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:26:53.115116 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c1fc1a00-d107-47d4-8c3d-d200710a9f74 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:53.116633 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c1fc1a00-d107-47d4-8c3d-d200710a9f74 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: be8904b8-7a85-4d46-9dce-64e3503eaccf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:53.128880 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c1fc1a00-d107-47d4-8c3d-d200710a9f74 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:53.129985 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c1fc1a00-d107-47d4-8c3d-d200710a9f74 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:53.131621 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c1fc1a00-d107-47d4-8c3d-d200710a9f74 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:53.133305 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c1fc1a00-d107-47d4-8c3d-d200710a9f74 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:53.149366 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7660f38d-ae17-4e02-b3a6-45bb798d4709 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:53.159217 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7660f38d-ae17-4e02-b3a6-45bb798d4709 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1312 microversion: 2.1 time: 0.156497 Aug 01 14:26:53.160094 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 458/904] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:53 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:53.288462 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c1fc1a00-d107-47d4-8c3d-d200710a9f74 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:53.297214 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c1fc1a00-d107-47d4-8c3d-d200710a9f74 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf" status: 200 len: 1680 microversion: 2.1 time: 0.188639 Aug 01 14:26:53.297786 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 447/905] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:53 2022] GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf => generated 1680 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:26:54.182805 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0e72cce0-b731-4353-89e9-bb1d72026ad0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:54.183478 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0e72cce0-b731-4353-89e9-bb1d72026ad0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:54.190115 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e72cce0-b731-4353-89e9-bb1d72026ad0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:54.191099 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e72cce0-b731-4353-89e9-bb1d72026ad0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:54.191908 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e72cce0-b731-4353-89e9-bb1d72026ad0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:54.192335 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e72cce0-b731-4353-89e9-bb1d72026ad0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:54.227016 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e72cce0-b731-4353-89e9-bb1d72026ad0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:54.227491 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0e72cce0-b731-4353-89e9-bb1d72026ad0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:54.227927 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-0e72cce0-b731-4353-89e9-bb1d72026ad0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lazy-loading 'fault' on Instance uuid 2775d75f-b4fd-451b-bba5-471868aafc29 {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:26:54.273658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0e72cce0-b731-4353-89e9-bb1d72026ad0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c487e443eb274090bce842e855b015ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6f2af7de6b4e888e702c78f655448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:54.283099 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0e72cce0-b731-4353-89e9-bb1d72026ad0 tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 200 len: 1312 microversion: 2.1 time: 0.104112 Aug 01 14:26:54.283722 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 459/906] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:54 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:54.319409 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-bf01a6f1-c961-4dab-bc7e-eddec7b7e410 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:54.320027 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-bf01a6f1-c961-4dab-bc7e-eddec7b7e410 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: be8904b8-7a85-4d46-9dce-64e3503eaccf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:54.326904 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bf01a6f1-c961-4dab-bc7e-eddec7b7e410 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:54.327361 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bf01a6f1-c961-4dab-bc7e-eddec7b7e410 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:54.328148 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bf01a6f1-c961-4dab-bc7e-eddec7b7e410 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:54.328578 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bf01a6f1-c961-4dab-bc7e-eddec7b7e410 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:54.494481 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-bf01a6f1-c961-4dab-bc7e-eddec7b7e410 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:54.502367 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-bf01a6f1-c961-4dab-bc7e-eddec7b7e410 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf" status: 200 len: 1680 microversion: 2.1 time: 0.186755 Aug 01 14:26:54.503340 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 448/907] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:54 2022] GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf => generated 1680 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:55.305356 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-312c5298-c09e-468b-be7a-24071511c7fc tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:55.306104 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-312c5298-c09e-468b-be7a-24071511c7fc tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] [instance: 2775d75f-b4fd-451b-bba5-471868aafc29] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:55.313793 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-312c5298-c09e-468b-be7a-24071511c7fc tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:55.314235 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-312c5298-c09e-468b-be7a-24071511c7fc tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:55.315003 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-312c5298-c09e-468b-be7a-24071511c7fc tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:55.315427 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-312c5298-c09e-468b-be7a-24071511c7fc tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:55.332749 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-312c5298-c09e-468b-be7a-24071511c7fc tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] HTTP exception thrown: Instance 2775d75f-b4fd-451b-bba5-471868aafc29 could not be found. Aug 01 14:26:55.334691 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-312c5298-c09e-468b-be7a-24071511c7fc tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Request method failure captured: Aug 01 14:26:55.334691 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 HTTP/1.1 Aug 01 14:26:55.334691 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept: application/json Aug 01 14:26:55.334691 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Aug 01 14:26:55.334691 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Connection: close Aug 01 14:26:55.334691 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Length: 0 Aug 01 14:26:55.334691 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Type: application/json Aug 01 14:26:55.334691 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Host: 10.222.0.17 Aug 01 14:26:55.334691 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Aug 01 14:26:55.334691 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.10 Aug 01 14:26:55.334691 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABi5-F11vtUeswQDfyKUVNd6Q87sVfV5PCR7Xd2YFUfSTJWvW9H9BSU4X5lFb9W0uL4F8nItvzcQSbBv2rf9PJYyTBlLiQDJSVh8lDqem48k4DbhTBdctnFQI9X7sX_oT1CnuXpX_5VYrPdv-R-oZXqnj9WBTnSUyuTG5740iwyNCsCcJ0 Aug 01 14:26:55.334691 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Aug 01 14:26:55.334691 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Aug 01 14:26:55.334691 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Aug 01 14:26:55.334691 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Aug 01 14:26:55.334691 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Aug 01 14:26:55.334691 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Aug 01 14:26:55.334691 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Id: 7b6f2af7de6b4e888e702c78f655448a Aug 01 14:26:55.334691 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1825573094 Aug 01 14:26:55.334691 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Role: reader,member Aug 01 14:26:55.334691 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Roles: reader,member Aug 01 14:26:55.337509 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7b6f2af7de6b4e888e702c78f655448a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7b6f2af7de6b4e888e702c78f655448a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7b6f2af7de6b4e888e702c78f655448a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7b6f2af7de6b4e888e702c78f655448a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:26:55.337509 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1825573094 Aug 01 14:26:55.337509 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 7b6f2af7de6b4e888e702c78f655448a Aug 01 14:26:55.337509 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1825573094 Aug 01 14:26:55.337509 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User: tempest-ServerRescueNegativeTestJSON-1825573094-project Aug 01 14:26:55.337509 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Aug 01 14:26:55.337509 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Aug 01 14:26:55.337509 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Id: c487e443eb274090bce842e855b015ec Aug 01 14:26:55.337509 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1825573094-project Aug 01 14:26:55.337509 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: method: > Aug 01 14:26:55.337509 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: exception: Instance 2775d75f-b4fd-451b-bba5-471868aafc29 could not be found. Aug 01 14:26:55.337509 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: action_args: {'id': '2775d75f-b4fd-451b-bba5-471868aafc29'} Aug 01 14:26:55.339036 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:26:55.339036 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:55.339036 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:26:55.339036 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:26:55.339036 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:26:55.339036 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:26:55.339036 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:26:55.339036 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:26:55.339036 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:26:55.339036 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:26:55.339036 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2775d75f-b4fd-451b-bba5-471868aafc29 could not be found. Aug 01 14:26:55.339036 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:26:55.339036 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:55.339036 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:26:55.339036 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:55.339036 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:55.339036 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:55.339036 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:26:55.339036 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:26:55.339036 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:26:55.340688 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:26:55.340688 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:26:55.340688 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:26:55.340688 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:26:55.340688 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:26:55.340688 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:26:55.340688 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:26:55.340688 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2775d75f-b4fd-451b-bba5-471868aafc29 could not be found. Aug 01 14:26:55.340688 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:26:55.340688 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:55.340688 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:26:55.340688 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:55.340688 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:55.340688 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:55.340688 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:26:55.340688 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:26:55.340688 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2775d75f-b4fd-451b-bba5-471868aafc29 could not be found. Aug 01 14:26:55.340688 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:26:55.342336 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-312c5298-c09e-468b-be7a-24071511c7fc tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] Returning 404 to user: Instance 2775d75f-b4fd-451b-bba5-471868aafc29 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:26:55.342336 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-312c5298-c09e-468b-be7a-24071511c7fc tempest-ServerRescueNegativeTestJSON-1825573094 tempest-ServerRescueNegativeTestJSON-1825573094-project] 10.222.0.17 "GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29" status: 404 len: 111 microversion: 2.1 time: 0.035229 Aug 01 14:26:55.342336 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 460/908] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:55 2022] GET /compute/v2.1/servers/2775d75f-b4fd-451b-bba5-471868aafc29 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:26:55.536094 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7a0a29f4-84a0-409a-970c-dc18ef90bb41 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:55.537414 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7a0a29f4-84a0-409a-970c-dc18ef90bb41 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: be8904b8-7a85-4d46-9dce-64e3503eaccf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:55.544970 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7a0a29f4-84a0-409a-970c-dc18ef90bb41 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:55.545786 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7a0a29f4-84a0-409a-970c-dc18ef90bb41 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:55.546853 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7a0a29f4-84a0-409a-970c-dc18ef90bb41 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:55.547539 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7a0a29f4-84a0-409a-970c-dc18ef90bb41 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:55.782772 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7a0a29f4-84a0-409a-970c-dc18ef90bb41 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eda4e19122444cf9cb2b6941adff9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3092982f3c6f4851a5a6e84bf7872d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:55.791699 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7a0a29f4-84a0-409a-970c-dc18ef90bb41 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf" status: 200 len: 1680 microversion: 2.1 time: 0.260447 Aug 01 14:26:55.792309 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 449/909] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:55 2022] GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf => generated 1680 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:56.057540 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-2e5d4317-aa5f-401c-9f43-dc9c2d012d85 req-d2426359-2e6f-46e8-b077-b073ab143008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be8904b8-7a85-4d46-9dce-64e3503eaccf", "name": "network-vif-deleted", "tag": "5c3eb081-f18c-4173-8f0c-a5499944600a"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:26:56.071592 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-2e5d4317-aa5f-401c-9f43-dc9c2d012d85 req-d2426359-2e6f-46e8-b077-b073ab143008 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:56.072334 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-2e5d4317-aa5f-401c-9f43-dc9c2d012d85 req-d2426359-2e6f-46e8-b077-b073ab143008 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:56.087749 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-2e5d4317-aa5f-401c-9f43-dc9c2d012d85 req-d2426359-2e6f-46e8-b077-b073ab143008 service nova] Creating event network-vif-deleted:5c3eb081-f18c-4173-8f0c-a5499944600a for instance be8904b8-7a85-4d46-9dce-64e3503eaccf on hv-cinder-84599 Aug 01 14:26:56.094557 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-2e5d4317-aa5f-401c-9f43-dc9c2d012d85 req-d2426359-2e6f-46e8-b077-b073ab143008 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045748 Aug 01 14:26:56.099212 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 461/910] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:26:56.822728 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b167dcc1-ea59-4021-9587-68dc9a1b4f47 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:56.824550 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b167dcc1-ea59-4021-9587-68dc9a1b4f47 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: be8904b8-7a85-4d46-9dce-64e3503eaccf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:56.838541 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b167dcc1-ea59-4021-9587-68dc9a1b4f47 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:56.839955 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b167dcc1-ea59-4021-9587-68dc9a1b4f47 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:56.842028 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b167dcc1-ea59-4021-9587-68dc9a1b4f47 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:56.843001 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b167dcc1-ea59-4021-9587-68dc9a1b4f47 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:56.863853 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-b167dcc1-ea59-4021-9587-68dc9a1b4f47 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] HTTP exception thrown: Instance be8904b8-7a85-4d46-9dce-64e3503eaccf could not be found. Aug 01 14:26:56.867057 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b167dcc1-ea59-4021-9587-68dc9a1b4f47 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Request method failure captured: Aug 01 14:26:56.867057 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf HTTP/1.1 Aug 01 14:26:56.867057 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:26:56.867057 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:26:56.867057 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:26:56.867057 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 0 Aug 01 14:26:56.867057 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:26:56.867057 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:26:56.867057 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:26:56.867057 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:26:56.867057 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-EkulQUZ9RnUqab4WEJwGiX-pJM7HxTgHalzWuk3LLo8fvk1GbjHf7oAdc4K40oSiRvHm3paXWQHzpNKMP3IF1Z4LwboIgWgWHXBlkSgdewDx_VoBUgWaMnbInPDU7YB5AlXhd0VLng73Y5VTtdj1967GURnhVKliVHkMShTgChU3Y Aug 01 14:26:56.867057 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:26:56.867057 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:26:56.867057 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:26:56.867057 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:26:56.867057 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:26:56.867057 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:26:56.867057 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: 3092982f3c6f4851a5a6e84bf7872d11 Aug 01 14:26:56.867057 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:26:56.867057 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:26:56.867057 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:26:56.868533 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3092982f3c6f4851a5a6e84bf7872d11", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:26:56.868533 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:26:56.868533 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 3092982f3c6f4851a5a6e84bf7872d11 Aug 01 14:26:56.868533 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:26:56.868533 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-AttachVolumeNegativeTest-134821563-project Aug 01 14:26:56.868533 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:26:56.868533 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:26:56.868533 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: 9eda4e19122444cf9cb2b6941adff9d5 Aug 01 14:26:56.868533 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-AttachVolumeNegativeTest-134821563-project Aug 01 14:26:56.868533 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: > Aug 01 14:26:56.868533 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Instance be8904b8-7a85-4d46-9dce-64e3503eaccf could not be found. Aug 01 14:26:56.868533 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'id': 'be8904b8-7a85-4d46-9dce-64e3503eaccf'} Aug 01 14:26:56.869440 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:26:56.869440 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:56.869440 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:26:56.869440 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:26:56.869440 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:26:56.869440 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:26:56.869440 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:26:56.869440 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:26:56.869440 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:26:56.869440 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:26:56.869440 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be8904b8-7a85-4d46-9dce-64e3503eaccf could not be found. Aug 01 14:26:56.869440 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:26:56.869440 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:56.869440 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:26:56.869440 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:56.869440 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:56.869440 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:56.869440 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:26:56.869440 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:26:56.869440 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:26:56.870604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:26:56.870604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:26:56.870604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:26:56.870604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:26:56.870604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:26:56.870604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:26:56.870604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:26:56.870604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be8904b8-7a85-4d46-9dce-64e3503eaccf could not be found. Aug 01 14:26:56.870604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:26:56.870604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:56.870604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:26:56.870604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:56.870604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:56.870604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:56.870604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:26:56.870604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:26:56.870604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be8904b8-7a85-4d46-9dce-64e3503eaccf could not be found. Aug 01 14:26:56.870604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:26:56.878315 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b167dcc1-ea59-4021-9587-68dc9a1b4f47 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Returning 404 to user: Instance be8904b8-7a85-4d46-9dce-64e3503eaccf could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:26:56.879628 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b167dcc1-ea59-4021-9587-68dc9a1b4f47 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf" status: 404 len: 111 microversion: 2.1 time: 0.067356 Aug 01 14:26:56.880607 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 450/911] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:56 2022] GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:26:56.892454 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c1e0a1f1-a9a1-4adc-aec2-90fe5f3ad543 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '.version_select at 0x7f6189d798b0>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:56.940264 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c1e0a1f1-a9a1-4adc-aec2-90fe5f3ad543 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1969136061" status: 202 len: 0 microversion: 2.1 time: 0.053125 Aug 01 14:26:56.941507 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 462/912] 10.222.0.17 () {58 vars in 1221 bytes} [Mon Aug 1 14:26:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1969136061 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:26:59.617519 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-46439122-45cc-487c-94dd-7545490f8168 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:59.618137 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-46439122-45cc-487c-94dd-7545490f8168 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: be8904b8-7a85-4d46-9dce-64e3503eaccf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:59.625272 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-46439122-45cc-487c-94dd-7545490f8168 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:59.625483 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-46439122-45cc-487c-94dd-7545490f8168 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:59.626591 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-46439122-45cc-487c-94dd-7545490f8168 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:59.626892 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-46439122-45cc-487c-94dd-7545490f8168 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:59.641676 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-46439122-45cc-487c-94dd-7545490f8168 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] HTTP exception thrown: Instance be8904b8-7a85-4d46-9dce-64e3503eaccf could not be found. Aug 01 14:26:59.643258 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-46439122-45cc-487c-94dd-7545490f8168 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Request method failure captured: Aug 01 14:26:59.643258 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: DELETE /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf HTTP/1.1 Aug 01 14:26:59.643258 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:26:59.643258 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:26:59.643258 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:26:59.643258 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 0 Aug 01 14:26:59.643258 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:26:59.643258 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:26:59.643258 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:26:59.643258 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:26:59.643258 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-EkulQUZ9RnUqab4WEJwGiX-pJM7HxTgHalzWuk3LLo8fvk1GbjHf7oAdc4K40oSiRvHm3paXWQHzpNKMP3IF1Z4LwboIgWgWHXBlkSgdewDx_VoBUgWaMnbInPDU7YB5AlXhd0VLng73Y5VTtdj1967GURnhVKliVHkMShTgChU3Y Aug 01 14:26:59.643258 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:26:59.643258 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:26:59.643258 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:26:59.643258 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:26:59.643258 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:26:59.643258 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:26:59.643258 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: 3092982f3c6f4851a5a6e84bf7872d11 Aug 01 14:26:59.643258 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:26:59.643258 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:26:59.643258 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:26:59.644700 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3092982f3c6f4851a5a6e84bf7872d11", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:26:59.644700 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:26:59.644700 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 3092982f3c6f4851a5a6e84bf7872d11 Aug 01 14:26:59.644700 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:26:59.644700 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-AttachVolumeNegativeTest-134821563-project Aug 01 14:26:59.644700 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:26:59.644700 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:26:59.644700 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: 9eda4e19122444cf9cb2b6941adff9d5 Aug 01 14:26:59.644700 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-AttachVolumeNegativeTest-134821563-project Aug 01 14:26:59.644700 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: > Aug 01 14:26:59.644700 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Instance be8904b8-7a85-4d46-9dce-64e3503eaccf could not be found. Aug 01 14:26:59.644700 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'id': 'be8904b8-7a85-4d46-9dce-64e3503eaccf'} Aug 01 14:26:59.645445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:26:59.645445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:59.645445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:26:59.645445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:26:59.645445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:26:59.645445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:26:59.645445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:26:59.645445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:26:59.645445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:26:59.645445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:26:59.645445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be8904b8-7a85-4d46-9dce-64e3503eaccf could not be found. Aug 01 14:26:59.645445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:26:59.645445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:59.645445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:26:59.645445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:59.645445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:59.645445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:59.645445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:26:59.645445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:26:59.645445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:26:59.646666 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:26:59.646666 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:26:59.646666 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:26:59.646666 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:26:59.646666 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:26:59.646666 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:26:59.646666 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:26:59.646666 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:26:59.646666 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:26:59.646666 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be8904b8-7a85-4d46-9dce-64e3503eaccf could not be found. Aug 01 14:26:59.646666 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:26:59.646666 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:59.646666 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:26:59.646666 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:59.646666 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:59.646666 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:59.646666 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:26:59.646666 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:26:59.646666 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be8904b8-7a85-4d46-9dce-64e3503eaccf could not be found. Aug 01 14:26:59.646666 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:26:59.650529 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-46439122-45cc-487c-94dd-7545490f8168 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Returning 404 to user: Instance be8904b8-7a85-4d46-9dce-64e3503eaccf could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:26:59.650529 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-46439122-45cc-487c-94dd-7545490f8168 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "DELETE /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf" status: 404 len: 111 microversion: 2.1 time: 0.031421 Aug 01 14:26:59.650529 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 451/913] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Aug 1 14:26:59 2022] DELETE /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:26:59.657909 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9208b818-ab9a-4b6d-95fe-907f913058e6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:59.659475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9208b818-ab9a-4b6d-95fe-907f913058e6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: be8904b8-7a85-4d46-9dce-64e3503eaccf] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:59.666889 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9208b818-ab9a-4b6d-95fe-907f913058e6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:59.667342 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9208b818-ab9a-4b6d-95fe-907f913058e6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:59.668230 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9208b818-ab9a-4b6d-95fe-907f913058e6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:59.668694 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9208b818-ab9a-4b6d-95fe-907f913058e6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:59.685217 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-9208b818-ab9a-4b6d-95fe-907f913058e6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] HTTP exception thrown: Instance be8904b8-7a85-4d46-9dce-64e3503eaccf could not be found. Aug 01 14:26:59.686991 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9208b818-ab9a-4b6d-95fe-907f913058e6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Request method failure captured: Aug 01 14:26:59.686991 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf HTTP/1.1 Aug 01 14:26:59.686991 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept: application/json Aug 01 14:26:59.686991 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Aug 01 14:26:59.686991 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Connection: close Aug 01 14:26:59.686991 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Length: 0 Aug 01 14:26:59.686991 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Type: application/json Aug 01 14:26:59.686991 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Host: 10.222.0.17 Aug 01 14:26:59.686991 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Aug 01 14:26:59.686991 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.10 Aug 01 14:26:59.686991 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABi5-EkulQUZ9RnUqab4WEJwGiX-pJM7HxTgHalzWuk3LLo8fvk1GbjHf7oAdc4K40oSiRvHm3paXWQHzpNKMP3IF1Z4LwboIgWgWHXBlkSgdewDx_VoBUgWaMnbInPDU7YB5AlXhd0VLng73Y5VTtdj1967GURnhVKliVHkMShTgChU3Y Aug 01 14:26:59.686991 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Aug 01 14:26:59.686991 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Aug 01 14:26:59.686991 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Aug 01 14:26:59.686991 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Aug 01 14:26:59.686991 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Aug 01 14:26:59.686991 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Aug 01 14:26:59.686991 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Id: 3092982f3c6f4851a5a6e84bf7872d11 Aug 01 14:26:59.686991 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:26:59.686991 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Role: reader,member Aug 01 14:26:59.686991 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Roles: reader,member Aug 01 14:26:59.689858 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3092982f3c6f4851a5a6e84bf7872d11", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:26:59.689858 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:26:59.689858 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 3092982f3c6f4851a5a6e84bf7872d11 Aug 01 14:26:59.689858 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:26:59.689858 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User: tempest-AttachVolumeNegativeTest-134821563-project Aug 01 14:26:59.689858 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Aug 01 14:26:59.689858 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Aug 01 14:26:59.689858 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Id: 9eda4e19122444cf9cb2b6941adff9d5 Aug 01 14:26:59.689858 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-AttachVolumeNegativeTest-134821563-project Aug 01 14:26:59.689858 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: method: > Aug 01 14:26:59.689858 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: exception: Instance be8904b8-7a85-4d46-9dce-64e3503eaccf could not be found. Aug 01 14:26:59.689858 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: action_args: {'id': 'be8904b8-7a85-4d46-9dce-64e3503eaccf'} Aug 01 14:26:59.691795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:26:59.691795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:59.691795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:26:59.691795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:26:59.691795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:26:59.691795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:26:59.691795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:26:59.691795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:26:59.691795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:26:59.691795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:26:59.691795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be8904b8-7a85-4d46-9dce-64e3503eaccf could not be found. Aug 01 14:26:59.691795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:26:59.691795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:59.691795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:26:59.691795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:59.691795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:59.691795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:59.691795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:26:59.691795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:26:59.691795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:26:59.695251 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:26:59.695251 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:26:59.695251 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:26:59.695251 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:26:59.695251 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:26:59.695251 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:26:59.695251 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:26:59.695251 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be8904b8-7a85-4d46-9dce-64e3503eaccf could not be found. Aug 01 14:26:59.695251 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:26:59.695251 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:59.695251 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:26:59.695251 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:59.695251 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:59.695251 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:59.695251 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:26:59.695251 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:26:59.695251 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be8904b8-7a85-4d46-9dce-64e3503eaccf could not be found. Aug 01 14:26:59.695251 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:26:59.700882 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9208b818-ab9a-4b6d-95fe-907f913058e6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Returning 404 to user: Instance be8904b8-7a85-4d46-9dce-64e3503eaccf could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:26:59.700882 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9208b818-ab9a-4b6d-95fe-907f913058e6 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf" status: 404 len: 111 microversion: 2.1 time: 0.036341 Aug 01 14:26:59.700882 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 463/914] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:59 2022] GET /compute/v2.1/servers/be8904b8-7a85-4d46-9dce-64e3503eaccf => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:27:00.892386 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a06e750c-13d4-4bf6-b349-be080754a53b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:00.893053 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a06e750c-13d4-4bf6-b349-be080754a53b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:00.899945 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a06e750c-13d4-4bf6-b349-be080754a53b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:00.900457 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a06e750c-13d4-4bf6-b349-be080754a53b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:00.901241 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a06e750c-13d4-4bf6-b349-be080754a53b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:00.901760 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a06e750c-13d4-4bf6-b349-be080754a53b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:00.917655 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-a06e750c-13d4-4bf6-b349-be080754a53b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] HTTP exception thrown: Instance 4ca84836-fe43-46c9-9829-ed762608ad39 could not be found. Aug 01 14:27:00.919999 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a06e750c-13d4-4bf6-b349-be080754a53b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Request method failure captured: Aug 01 14:27:00.919999 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: DELETE /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39 HTTP/1.1 Aug 01 14:27:00.919999 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:27:00.919999 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:27:00.919999 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:27:00.919999 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 0 Aug 01 14:27:00.919999 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:27:00.919999 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:27:00.919999 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:27:00.919999 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:27:00.919999 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-EkulQUZ9RnUqab4WEJwGiX-pJM7HxTgHalzWuk3LLo8fvk1GbjHf7oAdc4K40oSiRvHm3paXWQHzpNKMP3IF1Z4LwboIgWgWHXBlkSgdewDx_VoBUgWaMnbInPDU7YB5AlXhd0VLng73Y5VTtdj1967GURnhVKliVHkMShTgChU3Y Aug 01 14:27:00.919999 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:27:00.919999 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:27:00.919999 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:27:00.919999 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:27:00.919999 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:27:00.919999 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:27:00.919999 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: 3092982f3c6f4851a5a6e84bf7872d11 Aug 01 14:27:00.919999 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:27:00.919999 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:27:00.919999 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:27:00.922635 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3092982f3c6f4851a5a6e84bf7872d11", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:27:00.922635 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:27:00.922635 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 3092982f3c6f4851a5a6e84bf7872d11 Aug 01 14:27:00.922635 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:27:00.922635 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-AttachVolumeNegativeTest-134821563-project Aug 01 14:27:00.922635 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:27:00.922635 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:27:00.922635 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: 9eda4e19122444cf9cb2b6941adff9d5 Aug 01 14:27:00.922635 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-AttachVolumeNegativeTest-134821563-project Aug 01 14:27:00.922635 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: > Aug 01 14:27:00.922635 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Instance 4ca84836-fe43-46c9-9829-ed762608ad39 could not be found. Aug 01 14:27:00.922635 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'id': '4ca84836-fe43-46c9-9829-ed762608ad39'} Aug 01 14:27:00.924113 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:27:00.924113 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:00.924113 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:27:00.924113 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:27:00.924113 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:27:00.924113 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:27:00.924113 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:27:00.924113 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:27:00.924113 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:27:00.924113 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:27:00.924113 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ca84836-fe43-46c9-9829-ed762608ad39 could not be found. Aug 01 14:27:00.924113 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:00.924113 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:00.924113 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:00.924113 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:00.924113 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:00.924113 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:00.924113 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:27:00.924113 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:27:00.924113 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:27:00.926469 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:27:00.926469 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:27:00.926469 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:27:00.926469 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:27:00.926469 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:27:00.926469 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:27:00.926469 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:27:00.926469 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:27:00.926469 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:27:00.926469 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ca84836-fe43-46c9-9829-ed762608ad39 could not be found. Aug 01 14:27:00.926469 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:00.926469 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:00.926469 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:00.926469 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:00.926469 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:00.926469 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:00.926469 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:27:00.926469 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:27:00.926469 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ca84836-fe43-46c9-9829-ed762608ad39 could not be found. Aug 01 14:27:00.926469 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:00.930542 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a06e750c-13d4-4bf6-b349-be080754a53b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Returning 404 to user: Instance 4ca84836-fe43-46c9-9829-ed762608ad39 could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:27:00.930542 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a06e750c-13d4-4bf6-b349-be080754a53b tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39" status: 404 len: 111 microversion: 2.1 time: 0.032812 Aug 01 14:27:00.930542 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 452/915] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Aug 1 14:27:00 2022] DELETE /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 14:27:00.933650 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-08e3ed20-4981-4bbc-aec2-1c6ec5dfd125 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:00.934702 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-08e3ed20-4981-4bbc-aec2-1c6ec5dfd125 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: 4ca84836-fe43-46c9-9829-ed762608ad39] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:00.945697 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-08e3ed20-4981-4bbc-aec2-1c6ec5dfd125 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:00.946641 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-08e3ed20-4981-4bbc-aec2-1c6ec5dfd125 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:00.947744 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-08e3ed20-4981-4bbc-aec2-1c6ec5dfd125 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:00.948487 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-08e3ed20-4981-4bbc-aec2-1c6ec5dfd125 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:00.967705 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-08e3ed20-4981-4bbc-aec2-1c6ec5dfd125 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] HTTP exception thrown: Instance 4ca84836-fe43-46c9-9829-ed762608ad39 could not be found. Aug 01 14:27:00.970360 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-08e3ed20-4981-4bbc-aec2-1c6ec5dfd125 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Request method failure captured: Aug 01 14:27:00.970360 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39 HTTP/1.1 Aug 01 14:27:00.970360 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept: application/json Aug 01 14:27:00.970360 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Aug 01 14:27:00.970360 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Connection: close Aug 01 14:27:00.970360 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Length: 0 Aug 01 14:27:00.970360 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Type: application/json Aug 01 14:27:00.970360 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Host: 10.222.0.17 Aug 01 14:27:00.970360 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Aug 01 14:27:00.970360 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.10 Aug 01 14:27:00.970360 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABi5-EkulQUZ9RnUqab4WEJwGiX-pJM7HxTgHalzWuk3LLo8fvk1GbjHf7oAdc4K40oSiRvHm3paXWQHzpNKMP3IF1Z4LwboIgWgWHXBlkSgdewDx_VoBUgWaMnbInPDU7YB5AlXhd0VLng73Y5VTtdj1967GURnhVKliVHkMShTgChU3Y Aug 01 14:27:00.970360 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Aug 01 14:27:00.970360 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Aug 01 14:27:00.970360 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Aug 01 14:27:00.970360 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Aug 01 14:27:00.970360 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Aug 01 14:27:00.970360 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Aug 01 14:27:00.970360 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Id: 3092982f3c6f4851a5a6e84bf7872d11 Aug 01 14:27:00.970360 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:27:00.970360 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Role: reader,member Aug 01 14:27:00.970360 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Roles: reader,member Aug 01 14:27:00.973899 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3092982f3c6f4851a5a6e84bf7872d11", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:27:00.973899 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:27:00.973899 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 3092982f3c6f4851a5a6e84bf7872d11 Aug 01 14:27:00.973899 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:27:00.973899 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User: tempest-AttachVolumeNegativeTest-134821563-project Aug 01 14:27:00.973899 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Aug 01 14:27:00.973899 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Aug 01 14:27:00.973899 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Id: 9eda4e19122444cf9cb2b6941adff9d5 Aug 01 14:27:00.973899 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-AttachVolumeNegativeTest-134821563-project Aug 01 14:27:00.973899 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: method: > Aug 01 14:27:00.973899 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: exception: Instance 4ca84836-fe43-46c9-9829-ed762608ad39 could not be found. Aug 01 14:27:00.973899 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: action_args: {'id': '4ca84836-fe43-46c9-9829-ed762608ad39'} Aug 01 14:27:00.975588 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:27:00.975588 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:00.975588 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:27:00.975588 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:27:00.975588 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:27:00.975588 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:27:00.975588 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:27:00.975588 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:27:00.975588 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:27:00.975588 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:27:00.975588 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ca84836-fe43-46c9-9829-ed762608ad39 could not be found. Aug 01 14:27:00.975588 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:00.975588 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:00.975588 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:00.975588 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:00.975588 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:00.975588 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:00.975588 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:27:00.975588 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:27:00.975588 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:27:00.977266 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:27:00.977266 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:27:00.977266 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:27:00.977266 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:27:00.977266 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:27:00.977266 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:27:00.977266 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:27:00.977266 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ca84836-fe43-46c9-9829-ed762608ad39 could not be found. Aug 01 14:27:00.977266 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:00.977266 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:00.977266 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:00.977266 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:00.977266 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:00.977266 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:00.977266 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:27:00.977266 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:27:00.977266 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ca84836-fe43-46c9-9829-ed762608ad39 could not be found. Aug 01 14:27:00.977266 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:00.978510 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-08e3ed20-4981-4bbc-aec2-1c6ec5dfd125 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Returning 404 to user: Instance 4ca84836-fe43-46c9-9829-ed762608ad39 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:27:00.978510 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-08e3ed20-4981-4bbc-aec2-1c6ec5dfd125 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39" status: 404 len: 111 microversion: 2.1 time: 0.047902 Aug 01 14:27:00.978510 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 464/916] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:27:00 2022] GET /compute/v2.1/servers/4ca84836-fe43-46c9-9829-ed762608ad39 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:27:01.000961 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b8c5dfb4-dd7b-49a1-81a0-16193b8d17f7 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:01.001596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b8c5dfb4-dd7b-49a1-81a0-16193b8d17f7 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:01.009575 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b8c5dfb4-dd7b-49a1-81a0-16193b8d17f7 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:01.010213 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b8c5dfb4-dd7b-49a1-81a0-16193b8d17f7 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:01.011298 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b8c5dfb4-dd7b-49a1-81a0-16193b8d17f7 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:01.012044 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b8c5dfb4-dd7b-49a1-81a0-16193b8d17f7 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:01.029516 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-b8c5dfb4-dd7b-49a1-81a0-16193b8d17f7 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] HTTP exception thrown: Instance af4ff82b-d3d6-42c8-aeee-186eacd74c9d could not be found. Aug 01 14:27:01.031272 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b8c5dfb4-dd7b-49a1-81a0-16193b8d17f7 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Request method failure captured: Aug 01 14:27:01.031272 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: DELETE /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d HTTP/1.1 Aug 01 14:27:01.031272 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:27:01.031272 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:27:01.031272 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:27:01.031272 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 0 Aug 01 14:27:01.031272 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:27:01.031272 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:27:01.031272 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:27:01.031272 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:27:01.031272 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-EkulQUZ9RnUqab4WEJwGiX-pJM7HxTgHalzWuk3LLo8fvk1GbjHf7oAdc4K40oSiRvHm3paXWQHzpNKMP3IF1Z4LwboIgWgWHXBlkSgdewDx_VoBUgWaMnbInPDU7YB5AlXhd0VLng73Y5VTtdj1967GURnhVKliVHkMShTgChU3Y Aug 01 14:27:01.031272 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:27:01.031272 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:27:01.031272 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:27:01.031272 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:27:01.031272 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:27:01.031272 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:27:01.031272 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: 3092982f3c6f4851a5a6e84bf7872d11 Aug 01 14:27:01.031272 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:27:01.031272 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:27:01.031272 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:27:01.033879 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3092982f3c6f4851a5a6e84bf7872d11", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:27:01.033879 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:27:01.033879 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 3092982f3c6f4851a5a6e84bf7872d11 Aug 01 14:27:01.033879 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:27:01.033879 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-AttachVolumeNegativeTest-134821563-project Aug 01 14:27:01.033879 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:27:01.033879 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:27:01.033879 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: 9eda4e19122444cf9cb2b6941adff9d5 Aug 01 14:27:01.033879 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-AttachVolumeNegativeTest-134821563-project Aug 01 14:27:01.033879 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: > Aug 01 14:27:01.033879 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Instance af4ff82b-d3d6-42c8-aeee-186eacd74c9d could not be found. Aug 01 14:27:01.033879 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'id': 'af4ff82b-d3d6-42c8-aeee-186eacd74c9d'} Aug 01 14:27:01.035316 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:27:01.035316 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:01.035316 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:27:01.035316 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:27:01.035316 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:27:01.035316 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:27:01.035316 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:27:01.035316 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:27:01.035316 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:27:01.035316 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:27:01.035316 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af4ff82b-d3d6-42c8-aeee-186eacd74c9d could not be found. Aug 01 14:27:01.035316 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:01.035316 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:01.035316 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:01.035316 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:01.035316 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:01.035316 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:01.035316 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:27:01.035316 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:27:01.035316 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:27:01.037968 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:27:01.037968 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:27:01.037968 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:27:01.037968 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:27:01.037968 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:27:01.037968 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:27:01.037968 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:27:01.037968 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:27:01.037968 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:27:01.037968 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af4ff82b-d3d6-42c8-aeee-186eacd74c9d could not be found. Aug 01 14:27:01.037968 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:01.037968 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:01.037968 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:01.037968 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:01.037968 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:01.037968 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:01.037968 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:27:01.037968 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:27:01.037968 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af4ff82b-d3d6-42c8-aeee-186eacd74c9d could not be found. Aug 01 14:27:01.037968 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:01.042538 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b8c5dfb4-dd7b-49a1-81a0-16193b8d17f7 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Returning 404 to user: Instance af4ff82b-d3d6-42c8-aeee-186eacd74c9d could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:27:01.042538 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b8c5dfb4-dd7b-49a1-81a0-16193b8d17f7 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "DELETE /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 404 len: 111 microversion: 2.1 time: 0.052024 Aug 01 14:27:01.042538 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 453/917] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Aug 1 14:27:00 2022] DELETE /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:27:01.042919 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-646abd0c-b1b5-4bf8-8aad-ef74725c301d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:01.042919 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-646abd0c-b1b5-4bf8-8aad-ef74725c301d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: af4ff82b-d3d6-42c8-aeee-186eacd74c9d] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:01.050499 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-646abd0c-b1b5-4bf8-8aad-ef74725c301d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:01.050993 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-646abd0c-b1b5-4bf8-8aad-ef74725c301d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:01.051863 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-646abd0c-b1b5-4bf8-8aad-ef74725c301d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:01.052349 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-646abd0c-b1b5-4bf8-8aad-ef74725c301d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:01.068817 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-646abd0c-b1b5-4bf8-8aad-ef74725c301d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] HTTP exception thrown: Instance af4ff82b-d3d6-42c8-aeee-186eacd74c9d could not be found. Aug 01 14:27:01.070450 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-646abd0c-b1b5-4bf8-8aad-ef74725c301d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Request method failure captured: Aug 01 14:27:01.070450 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d HTTP/1.1 Aug 01 14:27:01.070450 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept: application/json Aug 01 14:27:01.070450 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Aug 01 14:27:01.070450 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Connection: close Aug 01 14:27:01.070450 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Length: 0 Aug 01 14:27:01.070450 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Type: application/json Aug 01 14:27:01.070450 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Host: 10.222.0.17 Aug 01 14:27:01.070450 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Aug 01 14:27:01.070450 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.10 Aug 01 14:27:01.070450 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABi5-EkulQUZ9RnUqab4WEJwGiX-pJM7HxTgHalzWuk3LLo8fvk1GbjHf7oAdc4K40oSiRvHm3paXWQHzpNKMP3IF1Z4LwboIgWgWHXBlkSgdewDx_VoBUgWaMnbInPDU7YB5AlXhd0VLng73Y5VTtdj1967GURnhVKliVHkMShTgChU3Y Aug 01 14:27:01.070450 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Aug 01 14:27:01.070450 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Aug 01 14:27:01.070450 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Aug 01 14:27:01.070450 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Aug 01 14:27:01.070450 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Aug 01 14:27:01.070450 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Aug 01 14:27:01.070450 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Id: 3092982f3c6f4851a5a6e84bf7872d11 Aug 01 14:27:01.070450 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:27:01.070450 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Role: reader,member Aug 01 14:27:01.070450 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Roles: reader,member Aug 01 14:27:01.073374 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3092982f3c6f4851a5a6e84bf7872d11", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:27:01.073374 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:27:01.073374 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 3092982f3c6f4851a5a6e84bf7872d11 Aug 01 14:27:01.073374 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:27:01.073374 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User: tempest-AttachVolumeNegativeTest-134821563-project Aug 01 14:27:01.073374 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Aug 01 14:27:01.073374 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Aug 01 14:27:01.073374 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Id: 9eda4e19122444cf9cb2b6941adff9d5 Aug 01 14:27:01.073374 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-AttachVolumeNegativeTest-134821563-project Aug 01 14:27:01.073374 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: method: > Aug 01 14:27:01.073374 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: exception: Instance af4ff82b-d3d6-42c8-aeee-186eacd74c9d could not be found. Aug 01 14:27:01.073374 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: action_args: {'id': 'af4ff82b-d3d6-42c8-aeee-186eacd74c9d'} Aug 01 14:27:01.078475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:27:01.078475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:01.078475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:27:01.078475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:27:01.078475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:27:01.078475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:27:01.078475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:27:01.078475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:27:01.078475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:27:01.078475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:27:01.078475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af4ff82b-d3d6-42c8-aeee-186eacd74c9d could not be found. Aug 01 14:27:01.078475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:01.078475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:01.078475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:01.078475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:01.078475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:01.078475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:01.078475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:27:01.078475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:27:01.078475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:27:01.081024 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:27:01.081024 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:27:01.081024 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:27:01.081024 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:27:01.081024 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:27:01.081024 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:27:01.081024 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:27:01.081024 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af4ff82b-d3d6-42c8-aeee-186eacd74c9d could not be found. Aug 01 14:27:01.081024 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:01.081024 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:01.081024 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:01.081024 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:01.081024 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:01.081024 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:01.081024 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:27:01.081024 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:27:01.081024 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af4ff82b-d3d6-42c8-aeee-186eacd74c9d could not be found. Aug 01 14:27:01.081024 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:01.083271 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-646abd0c-b1b5-4bf8-8aad-ef74725c301d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Returning 404 to user: Instance af4ff82b-d3d6-42c8-aeee-186eacd74c9d could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:27:01.083271 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-646abd0c-b1b5-4bf8-8aad-ef74725c301d tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d" status: 404 len: 111 microversion: 2.1 time: 0.034697 Aug 01 14:27:01.083271 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 465/918] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:27:01 2022] GET /compute/v2.1/servers/af4ff82b-d3d6-42c8-aeee-186eacd74c9d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 14:27:02.265847 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3f0c2c71-7c46-4ec5-b681-173c92bd8f5a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:02.267254 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3f0c2c71-7c46-4ec5-b681-173c92bd8f5a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:02.277779 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3f0c2c71-7c46-4ec5-b681-173c92bd8f5a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:02.279314 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3f0c2c71-7c46-4ec5-b681-173c92bd8f5a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:02.281279 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3f0c2c71-7c46-4ec5-b681-173c92bd8f5a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:02.282536 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3f0c2c71-7c46-4ec5-b681-173c92bd8f5a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:02.303754 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-3f0c2c71-7c46-4ec5-b681-173c92bd8f5a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] HTTP exception thrown: Instance fdb50660-a83d-4b80-9be9-f1c264f3d711 could not be found. Aug 01 14:27:02.307035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3f0c2c71-7c46-4ec5-b681-173c92bd8f5a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Request method failure captured: Aug 01 14:27:02.307035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: DELETE /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 HTTP/1.1 Aug 01 14:27:02.307035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:27:02.307035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:27:02.307035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:27:02.307035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 0 Aug 01 14:27:02.307035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:27:02.307035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:27:02.307035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:27:02.307035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:27:02.307035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-EkulQUZ9RnUqab4WEJwGiX-pJM7HxTgHalzWuk3LLo8fvk1GbjHf7oAdc4K40oSiRvHm3paXWQHzpNKMP3IF1Z4LwboIgWgWHXBlkSgdewDx_VoBUgWaMnbInPDU7YB5AlXhd0VLng73Y5VTtdj1967GURnhVKliVHkMShTgChU3Y Aug 01 14:27:02.307035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:27:02.307035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:27:02.307035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:27:02.307035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:27:02.307035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:27:02.307035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:27:02.307035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: 3092982f3c6f4851a5a6e84bf7872d11 Aug 01 14:27:02.307035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:27:02.307035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:27:02.307035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:27:02.308546 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3092982f3c6f4851a5a6e84bf7872d11", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:27:02.308546 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:27:02.308546 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 3092982f3c6f4851a5a6e84bf7872d11 Aug 01 14:27:02.308546 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:27:02.308546 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-AttachVolumeNegativeTest-134821563-project Aug 01 14:27:02.308546 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:27:02.308546 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:27:02.308546 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: 9eda4e19122444cf9cb2b6941adff9d5 Aug 01 14:27:02.308546 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-AttachVolumeNegativeTest-134821563-project Aug 01 14:27:02.308546 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: > Aug 01 14:27:02.308546 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Instance fdb50660-a83d-4b80-9be9-f1c264f3d711 could not be found. Aug 01 14:27:02.308546 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'id': 'fdb50660-a83d-4b80-9be9-f1c264f3d711'} Aug 01 14:27:02.309285 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:27:02.309285 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:02.309285 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:27:02.309285 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:27:02.309285 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:27:02.309285 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:27:02.309285 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:27:02.309285 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:27:02.309285 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:27:02.309285 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:27:02.309285 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdb50660-a83d-4b80-9be9-f1c264f3d711 could not be found. Aug 01 14:27:02.309285 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:02.309285 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:02.309285 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:02.309285 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:02.309285 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:02.309285 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:02.309285 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:27:02.309285 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:27:02.309285 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:27:02.310455 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:27:02.310455 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:27:02.310455 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:27:02.310455 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:27:02.310455 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:27:02.310455 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:27:02.310455 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:27:02.310455 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:27:02.310455 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:27:02.310455 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdb50660-a83d-4b80-9be9-f1c264f3d711 could not be found. Aug 01 14:27:02.310455 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:02.310455 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:02.310455 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:02.310455 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:02.310455 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:02.310455 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:02.310455 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:27:02.310455 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:27:02.310455 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdb50660-a83d-4b80-9be9-f1c264f3d711 could not be found. Aug 01 14:27:02.310455 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:02.314498 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3f0c2c71-7c46-4ec5-b681-173c92bd8f5a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Returning 404 to user: Instance fdb50660-a83d-4b80-9be9-f1c264f3d711 could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:27:02.315698 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3f0c2c71-7c46-4ec5-b681-173c92bd8f5a tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 404 len: 111 microversion: 2.1 time: 0.055257 Aug 01 14:27:02.316273 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 454/919] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Aug 1 14:27:02 2022] DELETE /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 14:27:02.328181 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-86a9f0d2-fa3d-462e-a29b-24a6897e6d91 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:02.329964 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-86a9f0d2-fa3d-462e-a29b-24a6897e6d91 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] [instance: fdb50660-a83d-4b80-9be9-f1c264f3d711] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:02.340469 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-86a9f0d2-fa3d-462e-a29b-24a6897e6d91 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:02.341745 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-86a9f0d2-fa3d-462e-a29b-24a6897e6d91 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:02.343217 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-86a9f0d2-fa3d-462e-a29b-24a6897e6d91 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:02.344207 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-86a9f0d2-fa3d-462e-a29b-24a6897e6d91 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:02.366197 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-86a9f0d2-fa3d-462e-a29b-24a6897e6d91 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] HTTP exception thrown: Instance fdb50660-a83d-4b80-9be9-f1c264f3d711 could not be found. Aug 01 14:27:02.368903 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-86a9f0d2-fa3d-462e-a29b-24a6897e6d91 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Request method failure captured: Aug 01 14:27:02.368903 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 HTTP/1.1 Aug 01 14:27:02.368903 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept: application/json Aug 01 14:27:02.368903 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Aug 01 14:27:02.368903 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Connection: close Aug 01 14:27:02.368903 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Length: 0 Aug 01 14:27:02.368903 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Type: application/json Aug 01 14:27:02.368903 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Host: 10.222.0.17 Aug 01 14:27:02.368903 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Aug 01 14:27:02.368903 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.10 Aug 01 14:27:02.368903 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABi5-EkulQUZ9RnUqab4WEJwGiX-pJM7HxTgHalzWuk3LLo8fvk1GbjHf7oAdc4K40oSiRvHm3paXWQHzpNKMP3IF1Z4LwboIgWgWHXBlkSgdewDx_VoBUgWaMnbInPDU7YB5AlXhd0VLng73Y5VTtdj1967GURnhVKliVHkMShTgChU3Y Aug 01 14:27:02.368903 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Aug 01 14:27:02.368903 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Aug 01 14:27:02.368903 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Aug 01 14:27:02.368903 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Aug 01 14:27:02.368903 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Aug 01 14:27:02.368903 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Aug 01 14:27:02.368903 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Id: 3092982f3c6f4851a5a6e84bf7872d11 Aug 01 14:27:02.368903 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:27:02.368903 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Role: reader,member Aug 01 14:27:02.368903 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Roles: reader,member Aug 01 14:27:02.371009 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3092982f3c6f4851a5a6e84bf7872d11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3092982f3c6f4851a5a6e84bf7872d11", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:27:02.371009 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:27:02.371009 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 3092982f3c6f4851a5a6e84bf7872d11 Aug 01 14:27:02.371009 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134821563 Aug 01 14:27:02.371009 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User: tempest-AttachVolumeNegativeTest-134821563-project Aug 01 14:27:02.371009 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Aug 01 14:27:02.371009 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Aug 01 14:27:02.371009 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Id: 9eda4e19122444cf9cb2b6941adff9d5 Aug 01 14:27:02.371009 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-AttachVolumeNegativeTest-134821563-project Aug 01 14:27:02.371009 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: method: > Aug 01 14:27:02.371009 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: exception: Instance fdb50660-a83d-4b80-9be9-f1c264f3d711 could not be found. Aug 01 14:27:02.371009 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: action_args: {'id': 'fdb50660-a83d-4b80-9be9-f1c264f3d711'} Aug 01 14:27:02.372252 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:27:02.372252 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:02.372252 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:27:02.372252 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:27:02.372252 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:27:02.372252 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:27:02.372252 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:27:02.372252 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:27:02.372252 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:27:02.372252 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:27:02.372252 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdb50660-a83d-4b80-9be9-f1c264f3d711 could not be found. Aug 01 14:27:02.372252 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:02.372252 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:02.372252 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:02.372252 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:02.372252 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:02.372252 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:02.372252 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:27:02.372252 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:27:02.372252 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:27:02.374140 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:27:02.374140 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:27:02.374140 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:27:02.374140 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:27:02.374140 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:27:02.374140 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:27:02.374140 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:27:02.374140 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdb50660-a83d-4b80-9be9-f1c264f3d711 could not be found. Aug 01 14:27:02.374140 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:02.374140 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:02.374140 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:02.374140 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:02.374140 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:02.374140 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:02.374140 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:27:02.374140 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:27:02.374140 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdb50660-a83d-4b80-9be9-f1c264f3d711 could not be found. Aug 01 14:27:02.374140 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:02.377648 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-86a9f0d2-fa3d-462e-a29b-24a6897e6d91 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] Returning 404 to user: Instance fdb50660-a83d-4b80-9be9-f1c264f3d711 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:27:02.379039 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-86a9f0d2-fa3d-462e-a29b-24a6897e6d91 tempest-AttachVolumeNegativeTest-134821563 tempest-AttachVolumeNegativeTest-134821563-project] 10.222.0.17 "GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711" status: 404 len: 111 microversion: 2.1 time: 0.057629 Aug 01 14:27:02.379817 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 466/920] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:27:02 2022] GET /compute/v2.1/servers/fdb50660-a83d-4b80-9be9-f1c264f3d711 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:27:07.726193 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e5230f1e-7b8f-43ac-a404-240249f20789 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Action: 'create', calling method: .version_select at 0x7f61854f6f70>, body: {"keypair": {"name": "tempest-keypair-1553627280", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkJ/nz71lBIkTmj431T4ud+wOE/RzZLuyciMAyyGjIK6jh2hOGqYVzKju0tylhNdnzTz3qHeLmE2E36Ui/yQBpK7VtRn/cXyOFqaO/fmqlKP+bNrozdSDNu3T0qCeyUEw=="}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:27:07.743193 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-e5230f1e-7b8f-43ac-a404-240249f20789 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Getting quotas for project 00a93cc41a184683a1fb82acfa2660a6. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:27:07.748324 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-e5230f1e-7b8f-43ac-a404-240249f20789 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Getting quotas for user 4079529de70f4994ab9f1f3dd5cb3fd7 and project 00a93cc41a184683a1fb82acfa2660a6. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:27:07.776448 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e5230f1e-7b8f-43ac-a404-240249f20789 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.528940 Aug 01 14:27:07.777557 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 455/921] 10.222.0.17 () {60 vars in 1159 bytes} [Mon Aug 1 14:27:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:27:09.415568 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e9498c29-42a4-492b-b7df-aa968a6fa103 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1674640491", "imageRef": "9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38460461-e63e-4e2b-95c5-9581a1400ff6"}], "security_groups": [{"name": "tempest-securitygroup--941881817"}], "key_name": "tempest-keypair-1553627280", "user_data": "}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:27:09.555731 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.network.neutron [None req-e9498c29-42a4-492b-b7df-aa968a6fa103 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] validate_networks() for [('38460461-e63e-4e2b-95c5-9581a1400ff6', None, None, None, None, None)] {{(pid=118132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:27:10.001469 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-e9498c29-42a4-492b-b7df-aa968a6fa103 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Flavor limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:27:10.001885 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-e9498c29-42a4-492b-b7df-aa968a6fa103 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Image limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:27:10.002661 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-e9498c29-42a4-492b-b7df-aa968a6fa103 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Flavor pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:27:10.003236 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-e9498c29-42a4-492b-b7df-aa968a6fa103 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Image pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:27:10.003840 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-e9498c29-42a4-492b-b7df-aa968a6fa103 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:27:10.015012 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e9498c29-42a4-492b-b7df-aa968a6fa103 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:10.015856 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e9498c29-42a4-492b-b7df-aa968a6fa103 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:10.016535 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e9498c29-42a4-492b-b7df-aa968a6fa103 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:10.016971 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e9498c29-42a4-492b-b7df-aa968a6fa103 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:10.042085 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-e9498c29-42a4-492b-b7df-aa968a6fa103 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Getting quotas for project 00a93cc41a184683a1fb82acfa2660a6. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:27:10.047035 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-e9498c29-42a4-492b-b7df-aa968a6fa103 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Getting quotas for user 4079529de70f4994ab9f1f3dd5cb3fd7 and project 00a93cc41a184683a1fb82acfa2660a6. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:27:10.061142 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e9498c29-42a4-492b-b7df-aa968a6fa103 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Going to run 1 instances... {{(pid=118132) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:27:10.063847 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e9498c29-42a4-492b-b7df-aa968a6fa103 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:27:10.123084 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e9498c29-42a4-492b-b7df-aa968a6fa103 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.712236 Aug 01 14:27:10.124376 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 467/922] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Aug 1 14:27:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:27:10.143427 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-53350b7c-cfc4-4653-9c7d-a659375c9021 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:10.144508 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-53350b7c-cfc4-4653-9c7d-a659375c9021 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:10.266853 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-53350b7c-cfc4-4653-9c7d-a659375c9021 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:10.274850 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-53350b7c-cfc4-4653-9c7d-a659375c9021 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1238 microversion: 2.1 time: 0.139304 Aug 01 14:27:10.288872 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 456/923] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:27:10 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1238 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:27:11.297516 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e13ec083-5e08-413b-8bc8-b9bc4af4db19 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:11.298111 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e13ec083-5e08-413b-8bc8-b9bc4af4db19 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:11.316615 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e13ec083-5e08-413b-8bc8-b9bc4af4db19 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:11.317380 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e13ec083-5e08-413b-8bc8-b9bc4af4db19 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:11.320784 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e13ec083-5e08-413b-8bc8-b9bc4af4db19 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:11.321319 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e13ec083-5e08-413b-8bc8-b9bc4af4db19 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:11.413325 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e13ec083-5e08-413b-8bc8-b9bc4af4db19 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:11.432844 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e13ec083-5e08-413b-8bc8-b9bc4af4db19 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1290 microversion: 2.1 time: 0.138320 Aug 01 14:27:11.437098 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 468/924] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:27:11 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1290 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:27:12.455557 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-04e10bd6-1c63-4290-b0ea-a6c1f0754f98 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:12.456662 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-04e10bd6-1c63-4290-b0ea-a6c1f0754f98 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:12.459548 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:12.467592 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-04e10bd6-1c63-4290-b0ea-a6c1f0754f98 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:12.468424 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-04e10bd6-1c63-4290-b0ea-a6c1f0754f98 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:12.469667 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-04e10bd6-1c63-4290-b0ea-a6c1f0754f98 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:12.470218 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-04e10bd6-1c63-4290-b0ea-a6c1f0754f98 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:12.561025 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-04e10bd6-1c63-4290-b0ea-a6c1f0754f98 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:12.578470 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-04e10bd6-1c63-4290-b0ea-a6c1f0754f98 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1296 microversion: 2.1 time: 0.127578 Aug 01 14:27:12.580315 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 457/925] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:27:12 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1296 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:27:13.602428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2c9f1da3-7ca9-4dc9-b584-c5b2cecbf8ea tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:13.602947 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2c9f1da3-7ca9-4dc9-b584-c5b2cecbf8ea tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:13.610742 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2c9f1da3-7ca9-4dc9-b584-c5b2cecbf8ea tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:13.611181 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2c9f1da3-7ca9-4dc9-b584-c5b2cecbf8ea tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:13.611987 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2c9f1da3-7ca9-4dc9-b584-c5b2cecbf8ea tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:13.612422 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2c9f1da3-7ca9-4dc9-b584-c5b2cecbf8ea tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:13.631620 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-c645569e-2d5f-4529-a3bb-e93c9b790839 req-087b63b5-4700-4f52-8b46-181565260718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32de816e-958f-4d99-a8cf-dc7f5522cf22", "tag": "d37f6e4c-b84c-4a23-bf23-c8d4f230dc2d"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:27:13.643705 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-c645569e-2d5f-4529-a3bb-e93c9b790839 req-087b63b5-4700-4f52-8b46-181565260718 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:13.644263 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-c645569e-2d5f-4529-a3bb-e93c9b790839 req-087b63b5-4700-4f52-8b46-181565260718 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:13.667594 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-c645569e-2d5f-4529-a3bb-e93c9b790839 req-087b63b5-4700-4f52-8b46-181565260718 service nova] Creating event network-changed:d37f6e4c-b84c-4a23-bf23-c8d4f230dc2d for instance 32de816e-958f-4d99-a8cf-dc7f5522cf22 on hv-cinder-84599 Aug 01 14:27:13.673592 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-c645569e-2d5f-4529-a3bb-e93c9b790839 req-087b63b5-4700-4f52-8b46-181565260718 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057540 Aug 01 14:27:13.674506 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 458/926] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:27:13.802699 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-2c9f1da3-7ca9-4dc9-b584-c5b2cecbf8ea tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:13.811813 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2c9f1da3-7ca9-4dc9-b584-c5b2cecbf8ea tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1363 microversion: 2.1 time: 0.213429 Aug 01 14:27:13.812432 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 469/927] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:27:13 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:27:14.832826 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-4f14eada-1a5c-4660-a5a4-f00fd1b3d9ae tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:14.833634 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-4f14eada-1a5c-4660-a5a4-f00fd1b3d9ae tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:14.840244 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4f14eada-1a5c-4660-a5a4-f00fd1b3d9ae tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:14.840680 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4f14eada-1a5c-4660-a5a4-f00fd1b3d9ae tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:14.841528 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4f14eada-1a5c-4660-a5a4-f00fd1b3d9ae tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:14.842038 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4f14eada-1a5c-4660-a5a4-f00fd1b3d9ae tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:14.983044 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4f14eada-1a5c-4660-a5a4-f00fd1b3d9ae tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:14.990764 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-4f14eada-1a5c-4660-a5a4-f00fd1b3d9ae tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1363 microversion: 2.1 time: 0.162588 Aug 01 14:27:14.991338 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 459/928] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:27:14 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:27:16.012987 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-faf336cc-fc8d-4666-9c83-8eb3935e6ed4 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:16.014091 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-faf336cc-fc8d-4666-9c83-8eb3935e6ed4 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:16.020340 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-faf336cc-fc8d-4666-9c83-8eb3935e6ed4 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:16.020782 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-faf336cc-fc8d-4666-9c83-8eb3935e6ed4 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:16.021806 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-faf336cc-fc8d-4666-9c83-8eb3935e6ed4 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:16.022102 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-faf336cc-fc8d-4666-9c83-8eb3935e6ed4 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:16.162658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-faf336cc-fc8d-4666-9c83-8eb3935e6ed4 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:16.172252 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-faf336cc-fc8d-4666-9c83-8eb3935e6ed4 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1363 microversion: 2.1 time: 0.163864 Aug 01 14:27:16.173158 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 470/929] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:27:16 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:27:17.194334 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5cecdf58-80fe-40d3-a541-ed4e5f71a749 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:17.194938 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5cecdf58-80fe-40d3-a541-ed4e5f71a749 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:17.198432 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:17.203586 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5cecdf58-80fe-40d3-a541-ed4e5f71a749 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:17.204030 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5cecdf58-80fe-40d3-a541-ed4e5f71a749 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:17.204793 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5cecdf58-80fe-40d3-a541-ed4e5f71a749 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:17.205217 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5cecdf58-80fe-40d3-a541-ed4e5f71a749 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:17.356007 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5cecdf58-80fe-40d3-a541-ed4e5f71a749 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:17.363979 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5cecdf58-80fe-40d3-a541-ed4e5f71a749 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1363 microversion: 2.1 time: 0.173775 Aug 01 14:27:17.364543 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 460/930] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:27:17 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:27:18.052252 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2e6a7658-5327-4272-8dd6-eff4377936c4 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-89940070"}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:27:18.053430 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2e6a7658-5327-4272-8dd6-eff4377936c4 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:18.055938 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:18.061843 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2e6a7658-5327-4272-8dd6-eff4377936c4 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:18.062290 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2e6a7658-5327-4272-8dd6-eff4377936c4 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:18.063067 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2e6a7658-5327-4272-8dd6-eff4377936c4 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:18.063524 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2e6a7658-5327-4272-8dd6-eff4377936c4 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:18.199701 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.network.security_group_api [None req-2e6a7658-5327-4272-8dd6-eff4377936c4 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Removing security group 1dd2b8d0-cae6-4911-a02c-23ac2a0b795b from port e829424e-7724-42ac-b5c9-19446ad3fa09 Aug 01 14:27:18.384601 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3fee5719-4378-47fd-b7ab-eaa520f84852 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:18.385219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3fee5719-4378-47fd-b7ab-eaa520f84852 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:18.405427 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3fee5719-4378-47fd-b7ab-eaa520f84852 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:18.405898 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3fee5719-4378-47fd-b7ab-eaa520f84852 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:18.406695 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3fee5719-4378-47fd-b7ab-eaa520f84852 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:18.407134 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3fee5719-4378-47fd-b7ab-eaa520f84852 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:18.543131 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2e6a7658-5327-4272-8dd6-eff4377936c4 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "POST /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f/action" status: 202 len: 0 microversion: 2.1 time: 0.494556 Aug 01 14:27:18.545040 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 471/931] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Aug 1 14:27:18 2022] POST /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f/action => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:27:18.551608 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-13e5e7fa-08da-4274-a2bb-434aa596750f req-2688a3d4-6adb-439b-a1ee-4523b9b78d4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75578a42-6025-4833-8349-dd37db5a195f", "tag": "e829424e-7724-42ac-b5c9-19446ad3fa09"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:27:18.568407 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-13e5e7fa-08da-4274-a2bb-434aa596750f req-2688a3d4-6adb-439b-a1ee-4523b9b78d4a service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:18.569197 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-13e5e7fa-08da-4274-a2bb-434aa596750f req-2688a3d4-6adb-439b-a1ee-4523b9b78d4a service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:18.575833 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:18.591205 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3fee5719-4378-47fd-b7ab-eaa520f84852 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:18.601219 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-13e5e7fa-08da-4274-a2bb-434aa596750f req-2688a3d4-6adb-439b-a1ee-4523b9b78d4a service nova] Creating event network-changed:e829424e-7724-42ac-b5c9-19446ad3fa09 for instance 75578a42-6025-4833-8349-dd37db5a195f on hv-cinder-84599 Aug 01 14:27:18.604197 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3fee5719-4378-47fd-b7ab-eaa520f84852 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1363 microversion: 2.1 time: 0.221326 Aug 01 14:27:18.605228 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 461/932] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:27:18 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:27:18.611165 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-13e5e7fa-08da-4274-a2bb-434aa596750f req-2688a3d4-6adb-439b-a1ee-4523b9b78d4a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063853 Aug 01 14:27:18.611928 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 472/933] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:27:18.876846 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-692574b5-36c8-4579-b760-07aa39468fb5 req-5305c3dd-aeb6-4d13-8224-b4983ab14329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32de816e-958f-4d99-a8cf-dc7f5522cf22", "name": "network-vif-plugged", "status": "completed", "tag": "d37f6e4c-b84c-4a23-bf23-c8d4f230dc2d"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:27:18.888029 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-692574b5-36c8-4579-b760-07aa39468fb5 req-5305c3dd-aeb6-4d13-8224-b4983ab14329 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:18.888739 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-692574b5-36c8-4579-b760-07aa39468fb5 req-5305c3dd-aeb6-4d13-8224-b4983ab14329 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:18.901858 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-692574b5-36c8-4579-b760-07aa39468fb5 req-5305c3dd-aeb6-4d13-8224-b4983ab14329 service nova] Creating event network-vif-plugged:d37f6e4c-b84c-4a23-bf23-c8d4f230dc2d for instance 32de816e-958f-4d99-a8cf-dc7f5522cf22 on hv-cinder-84599 Aug 01 14:27:18.909666 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-692574b5-36c8-4579-b760-07aa39468fb5 req-5305c3dd-aeb6-4d13-8224-b4983ab14329 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036321 Aug 01 14:27:18.911016 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 462/934] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:27:19.628319 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-74b0dd55-9f9a-46ec-bae9-908a78059e89 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:19.629735 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-74b0dd55-9f9a-46ec-bae9-908a78059e89 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:19.638820 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-74b0dd55-9f9a-46ec-bae9-908a78059e89 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:19.638820 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-74b0dd55-9f9a-46ec-bae9-908a78059e89 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:19.638820 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-74b0dd55-9f9a-46ec-bae9-908a78059e89 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:19.638820 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-74b0dd55-9f9a-46ec-bae9-908a78059e89 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:19.732438 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ca0a68da-34ce-4038-81d8-db54b3081b6c tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:19.733180 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ca0a68da-34ce-4038-81d8-db54b3081b6c tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:19.753489 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ca0a68da-34ce-4038-81d8-db54b3081b6c tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:19.753946 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ca0a68da-34ce-4038-81d8-db54b3081b6c tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:19.754728 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ca0a68da-34ce-4038-81d8-db54b3081b6c tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:19.755171 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ca0a68da-34ce-4038-81d8-db54b3081b6c tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:19.812228 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-74b0dd55-9f9a-46ec-bae9-908a78059e89 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:19.820975 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-74b0dd55-9f9a-46ec-bae9-908a78059e89 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1363 microversion: 2.1 time: 0.198207 Aug 01 14:27:19.821542 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 473/935] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:27:19 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:27:19.836073 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-fc98a496-eb37-4f81-a2b8-a2d686f01929 req-5cdac7ac-d722-4e7f-8f65-45f05c174804 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75578a42-6025-4833-8349-dd37db5a195f", "tag": "e829424e-7724-42ac-b5c9-19446ad3fa09"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:27:19.860446 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-fc98a496-eb37-4f81-a2b8-a2d686f01929 req-5cdac7ac-d722-4e7f-8f65-45f05c174804 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:19.861436 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-fc98a496-eb37-4f81-a2b8-a2d686f01929 req-5cdac7ac-d722-4e7f-8f65-45f05c174804 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:19.882835 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-ca0a68da-34ce-4038-81d8-db54b3081b6c tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lazy-loading 'services' on Instance uuid 75578a42-6025-4833-8349-dd37db5a195f {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:27:19.883719 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-fc98a496-eb37-4f81-a2b8-a2d686f01929 req-5cdac7ac-d722-4e7f-8f65-45f05c174804 service nova] Creating event network-changed:e829424e-7724-42ac-b5c9-19446ad3fa09 for instance 75578a42-6025-4833-8349-dd37db5a195f on hv-cinder-84599 Aug 01 14:27:19.888948 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-fc98a496-eb37-4f81-a2b8-a2d686f01929 req-5cdac7ac-d722-4e7f-8f65-45f05c174804 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065780 Aug 01 14:27:19.889723 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 474/936] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:27:19.971721 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ca0a68da-34ce-4038-81d8-db54b3081b6c tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "DELETE /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f/os-volume_attachments/0db0512e-14bf-46bf-b04d-5b78f99bc212" status: 202 len: 0 microversion: 2.1 time: 0.246921 Aug 01 14:27:19.975786 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 463/937] 10.222.0.17 () {58 vars in 1416 bytes} [Mon Aug 1 14:27:19 2022] DELETE /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f/os-volume_attachments/0db0512e-14bf-46bf-b04d-5b78f99bc212 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:27:19.986247 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-44b8520f-3ffb-43c5-b608-d85d2c48156e tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:19.989168 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-44b8520f-3ffb-43c5-b608-d85d2c48156e tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:19.996140 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-44b8520f-3ffb-43c5-b608-d85d2c48156e tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:19.997618 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-44b8520f-3ffb-43c5-b608-d85d2c48156e tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:19.998575 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-44b8520f-3ffb-43c5-b608-d85d2c48156e tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:19.999205 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-44b8520f-3ffb-43c5-b608-d85d2c48156e tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:20.030044 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=2 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:20.045702 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-44b8520f-3ffb-43c5-b608-d85d2c48156e tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067398 Aug 01 14:27:20.047048 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 475/938] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Aug 1 14:27:19 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:27:20.839241 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=6 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:20.844302 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b4e7a4ec-d133-46ae-bc87-e165c0ead8d2 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:20.845003 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b4e7a4ec-d133-46ae-bc87-e165c0ead8d2 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:20.851607 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b4e7a4ec-d133-46ae-bc87-e165c0ead8d2 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:20.852048 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b4e7a4ec-d133-46ae-bc87-e165c0ead8d2 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:20.852802 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b4e7a4ec-d133-46ae-bc87-e165c0ead8d2 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:20.853228 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b4e7a4ec-d133-46ae-bc87-e165c0ead8d2 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:20.986617 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b4e7a4ec-d133-46ae-bc87-e165c0ead8d2 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:20.996238 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b4e7a4ec-d133-46ae-bc87-e165c0ead8d2 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1549 microversion: 2.1 time: 0.157518 Aug 01 14:27:21.007631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 464/939] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:27:20 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:27:21.021855 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0aadcc28-f6c7-4f8a-91c1-a9784057e285 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:21.022360 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0aadcc28-f6c7-4f8a-91c1-a9784057e285 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:21.024401 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=6 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:21.030529 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0aadcc28-f6c7-4f8a-91c1-a9784057e285 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:21.030975 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0aadcc28-f6c7-4f8a-91c1-a9784057e285 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:21.031852 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0aadcc28-f6c7-4f8a-91c1-a9784057e285 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:21.032284 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0aadcc28-f6c7-4f8a-91c1-a9784057e285 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:21.060828 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b98af170-5c55-473a-9745-61bbfc766eb3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:21.063636 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b98af170-5c55-473a-9745-61bbfc766eb3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:21.071597 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b98af170-5c55-473a-9745-61bbfc766eb3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:21.073361 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b98af170-5c55-473a-9745-61bbfc766eb3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:21.074235 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b98af170-5c55-473a-9745-61bbfc766eb3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:21.074783 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b98af170-5c55-473a-9745-61bbfc766eb3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:21.111490 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b98af170-5c55-473a-9745-61bbfc766eb3 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056514 Aug 01 14:27:21.112091 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 465/940] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Aug 1 14:27:21 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:27:21.125090 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0aadcc28-f6c7-4f8a-91c1-a9784057e285 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107053 Aug 01 14:27:21.125808 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 476/941] 10.222.0.17 () {58 vars in 1275 bytes} [Mon Aug 1 14:27:21 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:27:21.675133 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a2e79c9c-a587-4d4b-942a-b33eb602b28a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:21.677377 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a2e79c9c-a587-4d4b-942a-b33eb602b28a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:21.685162 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a2e79c9c-a587-4d4b-942a-b33eb602b28a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:21.685644 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a2e79c9c-a587-4d4b-942a-b33eb602b28a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:21.686398 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a2e79c9c-a587-4d4b-942a-b33eb602b28a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:21.687039 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a2e79c9c-a587-4d4b-942a-b33eb602b28a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:21.726559 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a2e79c9c-a587-4d4b-942a-b33eb602b28a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055748 Aug 01 14:27:21.733622 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 466/942] 10.222.0.17 () {60 vars in 1343 bytes} [Mon Aug 1 14:27:21 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:27:21.800274 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4b729da8-8f09-43d4-b6cf-e80ae8b16cd2 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:21.800798 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4b729da8-8f09-43d4-b6cf-e80ae8b16cd2 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:21.807551 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4b729da8-8f09-43d4-b6cf-e80ae8b16cd2 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:21.808664 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4b729da8-8f09-43d4-b6cf-e80ae8b16cd2 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:21.809489 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4b729da8-8f09-43d4-b6cf-e80ae8b16cd2 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:21.812367 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4b729da8-8f09-43d4-b6cf-e80ae8b16cd2 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:21.843921 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4b729da8-8f09-43d4-b6cf-e80ae8b16cd2 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Going to try to terminate instance {{(pid=118132) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:27:21.947236 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4b729da8-8f09-43d4-b6cf-e80ae8b16cd2 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "DELETE /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 204 len: 0 microversion: 2.20 time: 0.150664 Aug 01 14:27:21.950270 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 477/943] 10.222.0.17 () {60 vars in 1280 bytes} [Mon Aug 1 14:27:21 2022] DELETE /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 14:27:21.958480 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e8bcc7df-8a00-4280-9376-72ef2c0b66b8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:21.960154 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e8bcc7df-8a00-4280-9376-72ef2c0b66b8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:21.969088 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e8bcc7df-8a00-4280-9376-72ef2c0b66b8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:21.969717 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e8bcc7df-8a00-4280-9376-72ef2c0b66b8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:21.970669 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e8bcc7df-8a00-4280-9376-72ef2c0b66b8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:21.971303 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e8bcc7df-8a00-4280-9376-72ef2c0b66b8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:22.125357 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c507fce1-aabb-4dd2-952b-a8dad3833bd9 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:22.128429 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c507fce1-aabb-4dd2-952b-a8dad3833bd9 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:22.135960 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c507fce1-aabb-4dd2-952b-a8dad3833bd9 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:22.136411 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c507fce1-aabb-4dd2-952b-a8dad3833bd9 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:22.137772 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c507fce1-aabb-4dd2-952b-a8dad3833bd9 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:22.138183 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c507fce1-aabb-4dd2-952b-a8dad3833bd9 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:22.176617 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c507fce1-aabb-4dd2-952b-a8dad3833bd9 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056521 Aug 01 14:27:22.177461 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 478/944] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Aug 1 14:27:22 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:27:22.188082 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f54a09f6-4fad-4efe-b214-76c6dd5880d9 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:22.188620 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f54a09f6-4fad-4efe-b214-76c6dd5880d9 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:22.196728 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f54a09f6-4fad-4efe-b214-76c6dd5880d9 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:22.197791 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f54a09f6-4fad-4efe-b214-76c6dd5880d9 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:22.198634 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f54a09f6-4fad-4efe-b214-76c6dd5880d9 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:22.199075 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f54a09f6-4fad-4efe-b214-76c6dd5880d9 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:22.225667 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e8bcc7df-8a00-4280-9376-72ef2c0b66b8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:22.235924 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e8bcc7df-8a00-4280-9376-72ef2c0b66b8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:22.237862 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e8bcc7df-8a00-4280-9376-72ef2c0b66b8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:22.240022 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e8bcc7df-8a00-4280-9376-72ef2c0b66b8 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1723 microversion: 2.20 time: 0.285211 Aug 01 14:27:22.240950 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 467/945] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:21 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:22.301050 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-f54a09f6-4fad-4efe-b214-76c6dd5880d9 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] HTTP exception thrown: Instance 75578a42-6025-4833-8349-dd37db5a195f is not attached to volume 0db0512e-14bf-46bf-b04d-5b78f99bc212 Aug 01 14:27:22.303980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f54a09f6-4fad-4efe-b214-76c6dd5880d9 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Request method failure captured: Aug 01 14:27:22.303980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: request: DELETE /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f/os-volume_attachments/0db0512e-14bf-46bf-b04d-5b78f99bc212 HTTP/1.1 Aug 01 14:27:22.303980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept: application/json Aug 01 14:27:22.303980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Aug 01 14:27:22.303980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Connection: close Aug 01 14:27:22.303980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Length: 0 Aug 01 14:27:22.303980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Type: application/json Aug 01 14:27:22.303980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Host: 10.222.0.17 Aug 01 14:27:22.303980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Aug 01 14:27:22.303980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.10 Aug 01 14:27:22.303980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABi5-I0gwCMkeaFtXoYvj6OwmV6c3UueJDpuOsPCpPbgAf98MWnLZOd79txRWgtCIY9ttohubu6awhgodhiJHIik1ckJnWsbTxQHLz3OReyZPuKKAe9PudKu4AELl35jPBxNMQiJGH2R9qv-80k3ttwgZZxkPBSyAHAcU1HOO0ZyV30XQE Aug 01 14:27:22.303980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Aug 01 14:27:22.303980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Aug 01 14:27:22.303980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Aug 01 14:27:22.303980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Aug 01 14:27:22.303980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Aug 01 14:27:22.303980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Aug 01 14:27:22.303980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Id: 83c251299d274471b80df4ff026b0102 Aug 01 14:27:22.303980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-TestMinimumBasicScenario-199853491 Aug 01 14:27:22.303980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Role: reader,member Aug 01 14:27:22.303980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Roles: reader,member Aug 01 14:27:22.306544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/83c251299d274471b80df4ff026b0102"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/83c251299d274471b80df4ff026b0102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/83c251299d274471b80df4ff026b0102"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_83c251299d274471b80df4ff026b0102", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:27:22.306544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-TestMinimumBasicScenario-199853491 Aug 01 14:27:22.306544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 83c251299d274471b80df4ff026b0102 Aug 01 14:27:22.306544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-TestMinimumBasicScenario-199853491 Aug 01 14:27:22.306544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User: tempest-TestMinimumBasicScenario-199853491-project Aug 01 14:27:22.306544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Aug 01 14:27:22.306544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Aug 01 14:27:22.306544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Id: 00393da6a11e4d77b5ad25b904f7187b Aug 01 14:27:22.306544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-TestMinimumBasicScenario-199853491-project Aug 01 14:27:22.306544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: method: > Aug 01 14:27:22.306544 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: exception: Instance 75578a42-6025-4833-8349-dd37db5a195f is not attached to volume 0db0512e-14bf-46bf-b04d-5b78f99bc212 Aug 01 14:27:22.312457 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: action_args: {'server_id': '75578a42-6025-4833-8349-dd37db5a195f', 'id': '0db0512e-14bf-46bf-b04d-5b78f99bc212'} Aug 01 14:27:22.312457 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:27:22.312457 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:22.312457 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 01 14:27:22.312457 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 01 14:27:22.312457 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 14:27:22.312457 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 14:27:22.312457 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 01 14:27:22.312457 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 01 14:27:22.312457 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0db0512e-14bf-46bf-b04d-5b78f99bc212. Aug 01 14:27:22.312457 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:22.312457 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:22.312457 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:22.312457 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:22.312457 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:22.312457 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:22.312457 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:27:22.312457 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:27:22.312457 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:27:22.313818 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:27:22.313818 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 01 14:27:22.313818 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 01 14:27:22.313818 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75578a42-6025-4833-8349-dd37db5a195f is not attached to volume 0db0512e-14bf-46bf-b04d-5b78f99bc212 Aug 01 14:27:22.313818 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:22.313818 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:22.313818 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:22.313818 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:22.313818 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:22.313818 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:22.313818 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:27:22.313818 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:27:22.313818 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75578a42-6025-4833-8349-dd37db5a195f is not attached to volume 0db0512e-14bf-46bf-b04d-5b78f99bc212 Aug 01 14:27:22.313818 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:22.313818 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f54a09f6-4fad-4efe-b214-76c6dd5880d9 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Returning 404 to user: Instance 75578a42-6025-4833-8349-dd37db5a195f is not attached to volume 0db0512e-14bf-46bf-b04d-5b78f99bc212 {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:27:22.315014 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f54a09f6-4fad-4efe-b214-76c6dd5880d9 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "DELETE /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f/os-volume_attachments/0db0512e-14bf-46bf-b04d-5b78f99bc212" status: 404 len: 154 microversion: 2.1 time: 0.122440 Aug 01 14:27:22.315014 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 479/946] 10.222.0.17 () {58 vars in 1416 bytes} [Mon Aug 1 14:27:22 2022] DELETE /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f/os-volume_attachments/0db0512e-14bf-46bf-b04d-5b78f99bc212 => generated 154 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 14:27:22.616640 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-309bbebc-3987-418a-9b58-b473a0c19a9d req-2cbdd4f6-2d9c-4570-b22b-441a7a5c8967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32de816e-958f-4d99-a8cf-dc7f5522cf22", "tag": "d37f6e4c-b84c-4a23-bf23-c8d4f230dc2d"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:27:22.628699 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-309bbebc-3987-418a-9b58-b473a0c19a9d req-2cbdd4f6-2d9c-4570-b22b-441a7a5c8967 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:22.629399 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-309bbebc-3987-418a-9b58-b473a0c19a9d req-2cbdd4f6-2d9c-4570-b22b-441a7a5c8967 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:22.642371 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-309bbebc-3987-418a-9b58-b473a0c19a9d req-2cbdd4f6-2d9c-4570-b22b-441a7a5c8967 service nova] Creating event network-changed:d37f6e4c-b84c-4a23-bf23-c8d4f230dc2d for instance 32de816e-958f-4d99-a8cf-dc7f5522cf22 on hv-cinder-84599 Aug 01 14:27:22.648180 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-309bbebc-3987-418a-9b58-b473a0c19a9d req-2cbdd4f6-2d9c-4570-b22b-441a7a5c8967 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035839 Aug 01 14:27:22.649536 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 468/947] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:27:23.266070 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a01da5e9-52bc-428c-8b91-7652d9b70218 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:23.267267 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a01da5e9-52bc-428c-8b91-7652d9b70218 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:23.275159 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a01da5e9-52bc-428c-8b91-7652d9b70218 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:23.275729 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a01da5e9-52bc-428c-8b91-7652d9b70218 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:23.278425 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a01da5e9-52bc-428c-8b91-7652d9b70218 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:23.278425 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a01da5e9-52bc-428c-8b91-7652d9b70218 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:23.474003 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a01da5e9-52bc-428c-8b91-7652d9b70218 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:23.489923 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a01da5e9-52bc-428c-8b91-7652d9b70218 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:23.495079 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a01da5e9-52bc-428c-8b91-7652d9b70218 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:23.496365 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a01da5e9-52bc-428c-8b91-7652d9b70218 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1723 microversion: 2.20 time: 0.236820 Aug 01 14:27:23.500579 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 480/948] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:23 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:23.527050 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6d61a1e0-8d85-42fc-be45-8eae3e4fd878 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:23.528617 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-6d61a1e0-8d85-42fc-be45-8eae3e4fd878 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:23.540981 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6d61a1e0-8d85-42fc-be45-8eae3e4fd878 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:23.541433 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6d61a1e0-8d85-42fc-be45-8eae3e4fd878 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:23.542488 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6d61a1e0-8d85-42fc-be45-8eae3e4fd878 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:23.542931 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6d61a1e0-8d85-42fc-be45-8eae3e4fd878 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:23.569931 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-6d61a1e0-8d85-42fc-be45-8eae3e4fd878 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Going to try to terminate instance {{(pid=118133) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:27:23.703210 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6d61a1e0-8d85-42fc-be45-8eae3e4fd878 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "DELETE /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 204 len: 0 microversion: 2.1 time: 0.189090 Aug 01 14:27:23.705237 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 469/949] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Aug 1 14:27:23 2022] DELETE /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:27:23.713878 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-edfc19df-1a86-43a0-8629-defb49f398ac tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:23.714707 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-edfc19df-1a86-43a0-8629-defb49f398ac tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:23.726632 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-edfc19df-1a86-43a0-8629-defb49f398ac tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:23.727347 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-edfc19df-1a86-43a0-8629-defb49f398ac tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:23.728707 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-edfc19df-1a86-43a0-8629-defb49f398ac tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:23.729220 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-edfc19df-1a86-43a0-8629-defb49f398ac tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:24.008179 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-edfc19df-1a86-43a0-8629-defb49f398ac tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:24.021687 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-edfc19df-1a86-43a0-8629-defb49f398ac tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1555 microversion: 2.1 time: 0.312302 Aug 01 14:27:24.023069 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 481/950] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:27:23 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1555 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:27:24.538839 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9eeb41b6-5f6e-49b2-956a-d168a1c112af tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:24.539982 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9eeb41b6-5f6e-49b2-956a-d168a1c112af tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:24.548530 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9eeb41b6-5f6e-49b2-956a-d168a1c112af tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:24.549205 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9eeb41b6-5f6e-49b2-956a-d168a1c112af tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:24.550024 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9eeb41b6-5f6e-49b2-956a-d168a1c112af tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:24.550595 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9eeb41b6-5f6e-49b2-956a-d168a1c112af tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:24.630572 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9eeb41b6-5f6e-49b2-956a-d168a1c112af tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:24.641875 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9eeb41b6-5f6e-49b2-956a-d168a1c112af tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:24.643445 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9eeb41b6-5f6e-49b2-956a-d168a1c112af tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:24.645482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9eeb41b6-5f6e-49b2-956a-d168a1c112af tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1655 microversion: 2.20 time: 0.113213 Aug 01 14:27:24.651556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 470/951] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:24 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1655 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:27:24.666043 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-2e75d279-f658-46cb-b23a-ab989a19a2fc req-b00a405f-d31f-4ab8-9d0e-a8b600418755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40a79ecf-b103-42e0-9cd6-d1daacb03f53", "name": "network-vif-deleted", "tag": "0379a8d6-df19-44b8-a731-76a7821a7444"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:27:24.679655 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-2e75d279-f658-46cb-b23a-ab989a19a2fc req-b00a405f-d31f-4ab8-9d0e-a8b600418755 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:24.680090 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-2e75d279-f658-46cb-b23a-ab989a19a2fc req-b00a405f-d31f-4ab8-9d0e-a8b600418755 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:24.693690 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-2e75d279-f658-46cb-b23a-ab989a19a2fc req-b00a405f-d31f-4ab8-9d0e-a8b600418755 service nova] Creating event network-vif-deleted:0379a8d6-df19-44b8-a731-76a7821a7444 for instance 40a79ecf-b103-42e0-9cd6-d1daacb03f53 on hv-cinder-84599 Aug 01 14:27:24.699119 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-2e75d279-f658-46cb-b23a-ab989a19a2fc req-b00a405f-d31f-4ab8-9d0e-a8b600418755 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036932 Aug 01 14:27:24.700757 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 482/952] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:27:25.042968 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-48bf3403-6e27-4e98-bcf6-e8b4a0ee7f3b tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:25.044291 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-48bf3403-6e27-4e98-bcf6-e8b4a0ee7f3b tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:25.050631 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-48bf3403-6e27-4e98-bcf6-e8b4a0ee7f3b tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:25.051084 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-48bf3403-6e27-4e98-bcf6-e8b4a0ee7f3b tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:25.051911 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-48bf3403-6e27-4e98-bcf6-e8b4a0ee7f3b tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:25.052438 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-48bf3403-6e27-4e98-bcf6-e8b4a0ee7f3b tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:25.193014 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-48bf3403-6e27-4e98-bcf6-e8b4a0ee7f3b tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:25.201733 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-48bf3403-6e27-4e98-bcf6-e8b4a0ee7f3b tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1555 microversion: 2.1 time: 0.162454 Aug 01 14:27:25.202578 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 471/953] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:27:25 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:27:25.670299 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d889d56b-25c3-4eff-86de-e07c746e1324 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:25.671077 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d889d56b-25c3-4eff-86de-e07c746e1324 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:25.680950 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d889d56b-25c3-4eff-86de-e07c746e1324 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:25.682091 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d889d56b-25c3-4eff-86de-e07c746e1324 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:25.683282 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d889d56b-25c3-4eff-86de-e07c746e1324 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:25.684692 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d889d56b-25c3-4eff-86de-e07c746e1324 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:25.737643 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d889d56b-25c3-4eff-86de-e07c746e1324 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:25.738393 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d889d56b-25c3-4eff-86de-e07c746e1324 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:25.739006 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-d889d56b-25c3-4eff-86de-e07c746e1324 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lazy-loading 'fault' on Instance uuid 40a79ecf-b103-42e0-9cd6-d1daacb03f53 {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:27:25.820001 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d889d56b-25c3-4eff-86de-e07c746e1324 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:25.830033 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d889d56b-25c3-4eff-86de-e07c746e1324 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:25.831574 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d889d56b-25c3-4eff-86de-e07c746e1324 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbaa67d901e34419b1616a8457fbd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb1590048254549bb480d677892031f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:25.833083 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d889d56b-25c3-4eff-86de-e07c746e1324 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 200 len: 1370 microversion: 2.20 time: 0.167630 Aug 01 14:27:25.833650 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 483/954] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:25 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:27:26.228334 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d773b205-7b99-45a8-afd7-6d5fbae75d65 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:26.229179 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d773b205-7b99-45a8-afd7-6d5fbae75d65 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:26.236610 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d773b205-7b99-45a8-afd7-6d5fbae75d65 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:26.237139 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d773b205-7b99-45a8-afd7-6d5fbae75d65 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:26.238001 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d773b205-7b99-45a8-afd7-6d5fbae75d65 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:26.238442 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d773b205-7b99-45a8-afd7-6d5fbae75d65 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:26.453403 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d773b205-7b99-45a8-afd7-6d5fbae75d65 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00393da6a11e4d77b5ad25b904f7187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c251299d274471b80df4ff026b0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:26.461773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d773b205-7b99-45a8-afd7-6d5fbae75d65 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 200 len: 1555 microversion: 2.1 time: 0.240868 Aug 01 14:27:26.462522 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 472/955] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:27:26 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 1555 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:27:26.713917 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-fb54c021-f653-4dfe-98b8-8b00c44903eb req-e9937ef0-1ab2-4a91-9016-32a4766f2a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75578a42-6025-4833-8349-dd37db5a195f", "name": "network-vif-deleted", "tag": "e829424e-7724-42ac-b5c9-19446ad3fa09"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:27:26.725979 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-fb54c021-f653-4dfe-98b8-8b00c44903eb req-e9937ef0-1ab2-4a91-9016-32a4766f2a03 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:26.726669 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-fb54c021-f653-4dfe-98b8-8b00c44903eb req-e9937ef0-1ab2-4a91-9016-32a4766f2a03 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:26.738781 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-fb54c021-f653-4dfe-98b8-8b00c44903eb req-e9937ef0-1ab2-4a91-9016-32a4766f2a03 service nova] Creating event network-vif-deleted:e829424e-7724-42ac-b5c9-19446ad3fa09 for instance 75578a42-6025-4833-8349-dd37db5a195f on hv-cinder-84599 Aug 01 14:27:26.743683 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-fb54c021-f653-4dfe-98b8-8b00c44903eb req-e9937ef0-1ab2-4a91-9016-32a4766f2a03 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033406 Aug 01 14:27:26.744283 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 484/956] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:27:26.856238 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-eac3768a-e445-49ed-9f48-8c8f877c1581 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:26.856852 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-eac3768a-e445-49ed-9f48-8c8f877c1581 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:26.863125 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-eac3768a-e445-49ed-9f48-8c8f877c1581 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:26.863538 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-eac3768a-e445-49ed-9f48-8c8f877c1581 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:26.864358 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-eac3768a-e445-49ed-9f48-8c8f877c1581 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:26.864892 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-eac3768a-e445-49ed-9f48-8c8f877c1581 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:26.879966 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:26.881404 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-eac3768a-e445-49ed-9f48-8c8f877c1581 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] HTTP exception thrown: Instance 40a79ecf-b103-42e0-9cd6-d1daacb03f53 could not be found. Aug 01 14:27:26.883046 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-eac3768a-e445-49ed-9f48-8c8f877c1581 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Request method failure captured: Aug 01 14:27:26.883046 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 HTTP/1.1 Aug 01 14:27:26.883046 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:27:26.883046 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:27:26.883046 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:27:26.883046 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 0 Aug 01 14:27:26.883046 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:27:26.883046 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:27:26.883046 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:27:26.883046 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:27:26.883046 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-EnTXKMlVzWiQvuoM3Li_7Xt8e8pzyVSu3I8Ovwsb05jmHaJIhXIfloZhNdo4gAbu7GPWwvsJeTl480IhROVHmaghvN-qiUMKCq9B07l6XFEquo1vchDUYVb3d185Gvq7QLtXjaK73JfW_xulof1LYuTsbvm4u6bw3hZw57cR1h5ds Aug 01 14:27:26.883046 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:27:26.883046 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:27:26.883046 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:27:26.883046 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:27:26.883046 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 14:27:26.883046 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:27:26.883046 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:27:26.883046 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: 2fb1590048254549bb480d677892031f Aug 01 14:27:26.883046 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-803629719 Aug 01 14:27:26.883046 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:27:26.883046 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:27:26.884456 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2fb1590048254549bb480d677892031f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2fb1590048254549bb480d677892031f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2fb1590048254549bb480d677892031f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2fb1590048254549bb480d677892031f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:27:26.884456 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-AttachVolumeShelveTestJSON-803629719 Aug 01 14:27:26.884456 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 2fb1590048254549bb480d677892031f Aug 01 14:27:26.884456 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-803629719 Aug 01 14:27:26.884456 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-AttachVolumeShelveTestJSON-803629719-project Aug 01 14:27:26.884456 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:27:26.884456 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:27:26.884456 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: fbaa67d901e34419b1616a8457fbd683 Aug 01 14:27:26.884456 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-AttachVolumeShelveTestJSON-803629719-project Aug 01 14:27:26.884456 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: > Aug 01 14:27:26.884456 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Instance 40a79ecf-b103-42e0-9cd6-d1daacb03f53 could not be found. Aug 01 14:27:26.884456 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'id': '40a79ecf-b103-42e0-9cd6-d1daacb03f53'} Aug 01 14:27:26.885207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:27:26.885207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:26.885207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:27:26.885207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:27:26.885207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:27:26.885207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:27:26.885207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:27:26.885207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:27:26.885207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:27:26.885207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:27:26.885207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40a79ecf-b103-42e0-9cd6-d1daacb03f53 could not be found. Aug 01 14:27:26.885207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:26.885207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:26.885207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:26.885207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:26.885207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:26.885207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:26.885207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:27:26.885207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:27:26.885207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:27:26.886365 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:27:26.886365 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:27:26.886365 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:27:26.886365 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:27:26.886365 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:27:26.886365 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:27:26.886365 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:27:26.886365 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40a79ecf-b103-42e0-9cd6-d1daacb03f53 could not be found. Aug 01 14:27:26.886365 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:26.886365 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:26.886365 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:26.886365 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:26.886365 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:26.886365 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:26.886365 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:27:26.886365 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:27:26.886365 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40a79ecf-b103-42e0-9cd6-d1daacb03f53 could not be found. Aug 01 14:27:26.886365 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:26.888775 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-eac3768a-e445-49ed-9f48-8c8f877c1581 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Returning 404 to user: Instance 40a79ecf-b103-42e0-9cd6-d1daacb03f53 could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:27:26.888775 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-eac3768a-e445-49ed-9f48-8c8f877c1581 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 404 len: 111 microversion: 2.20 time: 0.032389 Aug 01 14:27:26.888775 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 473/957] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:26 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 01 14:27:26.895138 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-03729637-ecca-41c3-99b5-492979396078 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '.version_select at 0x7f6184f22d30>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:26.916816 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-03729637-ecca-41c3-99b5-492979396078 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-52270305" status: 204 len: 0 microversion: 2.20 time: 0.026358 Aug 01 14:27:26.917493 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 485/958] 10.222.0.17 () {60 vars in 1256 bytes} [Mon Aug 1 14:27:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-52270305 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 01 14:27:27.484061 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-29cd97a0-f2c5-4259-a4d1-57dc29d0c525 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:27.484682 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-29cd97a0-f2c5-4259-a4d1-57dc29d0c525 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] [instance: 75578a42-6025-4833-8349-dd37db5a195f] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:27.492861 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-29cd97a0-f2c5-4259-a4d1-57dc29d0c525 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:27.493313 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-29cd97a0-f2c5-4259-a4d1-57dc29d0c525 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:27.494105 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-29cd97a0-f2c5-4259-a4d1-57dc29d0c525 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:27.494808 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-29cd97a0-f2c5-4259-a4d1-57dc29d0c525 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:27.511432 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-29cd97a0-f2c5-4259-a4d1-57dc29d0c525 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] HTTP exception thrown: Instance 75578a42-6025-4833-8349-dd37db5a195f could not be found. Aug 01 14:27:27.513971 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-29cd97a0-f2c5-4259-a4d1-57dc29d0c525 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Request method failure captured: Aug 01 14:27:27.513971 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f HTTP/1.1 Aug 01 14:27:27.513971 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:27:27.513971 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:27:27.513971 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:27:27.513971 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 0 Aug 01 14:27:27.513971 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:27:27.513971 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:27:27.513971 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:27:27.513971 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:27:27.513971 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-I0gwCMkeaFtXoYvj6OwmV6c3UueJDpuOsPCpPbgAf98MWnLZOd79txRWgtCIY9ttohubu6awhgodhiJHIik1ckJnWsbTxQHLz3OReyZPuKKAe9PudKu4AELl35jPBxNMQiJGH2R9qv-80k3ttwgZZxkPBSyAHAcU1HOO0ZyV30XQE Aug 01 14:27:27.513971 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:27:27.513971 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:27:27.513971 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:27:27.513971 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:27:27.513971 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:27:27.513971 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:27:27.513971 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: 83c251299d274471b80df4ff026b0102 Aug 01 14:27:27.513971 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-TestMinimumBasicScenario-199853491 Aug 01 14:27:27.513971 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:27:27.513971 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:27:27.515804 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/83c251299d274471b80df4ff026b0102"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/83c251299d274471b80df4ff026b0102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/83c251299d274471b80df4ff026b0102"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_83c251299d274471b80df4ff026b0102", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:27:27.515804 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-TestMinimumBasicScenario-199853491 Aug 01 14:27:27.515804 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 83c251299d274471b80df4ff026b0102 Aug 01 14:27:27.515804 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-TestMinimumBasicScenario-199853491 Aug 01 14:27:27.515804 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-TestMinimumBasicScenario-199853491-project Aug 01 14:27:27.515804 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:27:27.515804 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:27:27.515804 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: 00393da6a11e4d77b5ad25b904f7187b Aug 01 14:27:27.515804 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-TestMinimumBasicScenario-199853491-project Aug 01 14:27:27.515804 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: > Aug 01 14:27:27.515804 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Instance 75578a42-6025-4833-8349-dd37db5a195f could not be found. Aug 01 14:27:27.515804 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'id': '75578a42-6025-4833-8349-dd37db5a195f'} Aug 01 14:27:27.516927 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:27:27.516927 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:27.516927 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:27:27.516927 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:27:27.516927 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:27:27.516927 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:27:27.516927 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:27:27.516927 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:27:27.516927 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:27:27.516927 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:27:27.516927 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75578a42-6025-4833-8349-dd37db5a195f could not be found. Aug 01 14:27:27.516927 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:27.516927 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:27.516927 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:27.516927 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:27.516927 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:27.516927 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:27.516927 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:27:27.516927 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:27:27.516927 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:27:27.518331 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:27:27.518331 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:27:27.518331 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:27:27.518331 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:27:27.518331 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:27:27.518331 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:27:27.518331 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:27:27.518331 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75578a42-6025-4833-8349-dd37db5a195f could not be found. Aug 01 14:27:27.518331 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:27.518331 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:27.518331 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:27.518331 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:27.518331 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:27.518331 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:27.518331 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:27:27.518331 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:27:27.518331 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75578a42-6025-4833-8349-dd37db5a195f could not be found. Aug 01 14:27:27.518331 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:27.519895 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-29cd97a0-f2c5-4259-a4d1-57dc29d0c525 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Returning 404 to user: Instance 75578a42-6025-4833-8349-dd37db5a195f could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:27:27.519895 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-29cd97a0-f2c5-4259-a4d1-57dc29d0c525 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f" status: 404 len: 111 microversion: 2.1 time: 0.035792 Aug 01 14:27:27.520209 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 474/959] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:27:27 2022] GET /compute/v2.1/servers/75578a42-6025-4833-8349-dd37db5a195f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:27:27.524804 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b23217cc-5d80-4dae-95cc-413f9dae4692 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] Calling method '.version_select at 0x7f6184c57d30>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:27.547263 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b23217cc-5d80-4dae-95cc-413f9dae4692 tempest-TestMinimumBasicScenario-199853491 tempest-TestMinimumBasicScenario-199853491-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2088314358" status: 202 len: 0 microversion: 2.1 time: 0.026237 Aug 01 14:27:27.547982 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 486/960] 10.222.0.17 () {58 vars in 1272 bytes} [Mon Aug 1 14:27:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2088314358 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 14:27:28.814076 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d57fb51b-8584-4d5b-bc7e-69e2ebbecf95 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:28.814609 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d57fb51b-8584-4d5b-bc7e-69e2ebbecf95 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:28.821387 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d57fb51b-8584-4d5b-bc7e-69e2ebbecf95 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:28.821919 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d57fb51b-8584-4d5b-bc7e-69e2ebbecf95 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:28.822773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d57fb51b-8584-4d5b-bc7e-69e2ebbecf95 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:28.823305 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d57fb51b-8584-4d5b-bc7e-69e2ebbecf95 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:28.837618 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-d57fb51b-8584-4d5b-bc7e-69e2ebbecf95 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] HTTP exception thrown: Instance 40a79ecf-b103-42e0-9cd6-d1daacb03f53 could not be found. Aug 01 14:27:28.839527 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d57fb51b-8584-4d5b-bc7e-69e2ebbecf95 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Request method failure captured: Aug 01 14:27:28.839527 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: DELETE /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 HTTP/1.1 Aug 01 14:27:28.839527 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:27:28.839527 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:27:28.839527 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:27:28.839527 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 0 Aug 01 14:27:28.839527 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:27:28.839527 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:27:28.839527 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:27:28.839527 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:27:28.839527 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-EnTXKMlVzWiQvuoM3Li_7Xt8e8pzyVSu3I8Ovwsb05jmHaJIhXIfloZhNdo4gAbu7GPWwvsJeTl480IhROVHmaghvN-qiUMKCq9B07l6XFEquo1vchDUYVb3d185Gvq7QLtXjaK73JfW_xulof1LYuTsbvm4u6bw3hZw57cR1h5ds Aug 01 14:27:28.839527 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:27:28.839527 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:27:28.839527 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:27:28.839527 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:27:28.839527 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 14:27:28.839527 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:27:28.839527 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:27:28.839527 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: 2fb1590048254549bb480d677892031f Aug 01 14:27:28.839527 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-803629719 Aug 01 14:27:28.839527 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:27:28.839527 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:27:28.841712 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2fb1590048254549bb480d677892031f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2fb1590048254549bb480d677892031f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2fb1590048254549bb480d677892031f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2fb1590048254549bb480d677892031f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:27:28.841712 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-AttachVolumeShelveTestJSON-803629719 Aug 01 14:27:28.841712 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 2fb1590048254549bb480d677892031f Aug 01 14:27:28.841712 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-803629719 Aug 01 14:27:28.841712 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-AttachVolumeShelveTestJSON-803629719-project Aug 01 14:27:28.841712 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:27:28.841712 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:27:28.841712 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: fbaa67d901e34419b1616a8457fbd683 Aug 01 14:27:28.841712 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-AttachVolumeShelveTestJSON-803629719-project Aug 01 14:27:28.841712 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: > Aug 01 14:27:28.841712 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Instance 40a79ecf-b103-42e0-9cd6-d1daacb03f53 could not be found. Aug 01 14:27:28.841712 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'id': '40a79ecf-b103-42e0-9cd6-d1daacb03f53'} Aug 01 14:27:28.842556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:27:28.842556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:28.842556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:27:28.842556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:27:28.842556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:27:28.842556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:27:28.842556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:27:28.842556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:27:28.842556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:27:28.842556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:27:28.842556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40a79ecf-b103-42e0-9cd6-d1daacb03f53 could not be found. Aug 01 14:27:28.842556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:28.842556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:28.842556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:28.842556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:28.842556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:28.842556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:28.842556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:27:28.842556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:27:28.842556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:27:28.844381 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:27:28.844381 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:27:28.844381 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:27:28.844381 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:27:28.844381 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:27:28.844381 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:27:28.844381 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:27:28.844381 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:27:28.844381 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:27:28.844381 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40a79ecf-b103-42e0-9cd6-d1daacb03f53 could not be found. Aug 01 14:27:28.844381 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:28.844381 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:28.844381 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:28.844381 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:28.844381 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:28.844381 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:28.844381 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:27:28.844381 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:27:28.844381 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40a79ecf-b103-42e0-9cd6-d1daacb03f53 could not be found. Aug 01 14:27:28.844381 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:28.846925 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d57fb51b-8584-4d5b-bc7e-69e2ebbecf95 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Returning 404 to user: Instance 40a79ecf-b103-42e0-9cd6-d1daacb03f53 could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:27:28.846925 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d57fb51b-8584-4d5b-bc7e-69e2ebbecf95 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "DELETE /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 404 len: 111 microversion: 2.20 time: 0.032010 Aug 01 14:27:28.846925 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 475/961] 10.222.0.17 () {60 vars in 1280 bytes} [Mon Aug 1 14:27:28 2022] DELETE /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:27:28.853190 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-452b9eb9-4dd5-4faa-8939-7aa3e5a0cb0f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:28.854737 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-452b9eb9-4dd5-4faa-8939-7aa3e5a0cb0f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 40a79ecf-b103-42e0-9cd6-d1daacb03f53] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:28.862291 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-452b9eb9-4dd5-4faa-8939-7aa3e5a0cb0f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:28.863152 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-452b9eb9-4dd5-4faa-8939-7aa3e5a0cb0f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:28.864043 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-452b9eb9-4dd5-4faa-8939-7aa3e5a0cb0f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:28.864695 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-452b9eb9-4dd5-4faa-8939-7aa3e5a0cb0f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:28.899084 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-452b9eb9-4dd5-4faa-8939-7aa3e5a0cb0f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] HTTP exception thrown: Instance 40a79ecf-b103-42e0-9cd6-d1daacb03f53 could not be found. Aug 01 14:27:28.901428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-452b9eb9-4dd5-4faa-8939-7aa3e5a0cb0f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Request method failure captured: Aug 01 14:27:28.901428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 HTTP/1.1 Aug 01 14:27:28.901428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept: application/json Aug 01 14:27:28.901428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Aug 01 14:27:28.901428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Connection: close Aug 01 14:27:28.901428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Length: 0 Aug 01 14:27:28.901428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Type: application/json Aug 01 14:27:28.901428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Host: 10.222.0.17 Aug 01 14:27:28.901428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Aug 01 14:27:28.901428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.10 Aug 01 14:27:28.901428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABi5-EnTXKMlVzWiQvuoM3Li_7Xt8e8pzyVSu3I8Ovwsb05jmHaJIhXIfloZhNdo4gAbu7GPWwvsJeTl480IhROVHmaghvN-qiUMKCq9B07l6XFEquo1vchDUYVb3d185Gvq7QLtXjaK73JfW_xulof1LYuTsbvm4u6bw3hZw57cR1h5ds Aug 01 14:27:28.901428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Aug 01 14:27:28.901428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Aug 01 14:27:28.901428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Aug 01 14:27:28.901428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Aug 01 14:27:28.901428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 14:27:28.901428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Aug 01 14:27:28.901428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Aug 01 14:27:28.901428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Id: 2fb1590048254549bb480d677892031f Aug 01 14:27:28.901428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-803629719 Aug 01 14:27:28.901428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Role: reader,member Aug 01 14:27:28.901428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Roles: reader,member Aug 01 14:27:28.903418 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2fb1590048254549bb480d677892031f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2fb1590048254549bb480d677892031f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2fb1590048254549bb480d677892031f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2fb1590048254549bb480d677892031f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:27:28.903418 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-AttachVolumeShelveTestJSON-803629719 Aug 01 14:27:28.903418 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 2fb1590048254549bb480d677892031f Aug 01 14:27:28.903418 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-803629719 Aug 01 14:27:28.903418 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User: tempest-AttachVolumeShelveTestJSON-803629719-project Aug 01 14:27:28.903418 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Aug 01 14:27:28.903418 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Aug 01 14:27:28.903418 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Id: fbaa67d901e34419b1616a8457fbd683 Aug 01 14:27:28.903418 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-AttachVolumeShelveTestJSON-803629719-project Aug 01 14:27:28.903418 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: method: > Aug 01 14:27:28.903418 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: exception: Instance 40a79ecf-b103-42e0-9cd6-d1daacb03f53 could not be found. Aug 01 14:27:28.903418 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: action_args: {'id': '40a79ecf-b103-42e0-9cd6-d1daacb03f53'} Aug 01 14:27:28.904220 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:27:28.904220 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:28.904220 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:27:28.904220 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:27:28.904220 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:27:28.904220 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:27:28.904220 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:27:28.904220 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:27:28.904220 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:27:28.904220 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:27:28.904220 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40a79ecf-b103-42e0-9cd6-d1daacb03f53 could not be found. Aug 01 14:27:28.904220 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:28.904220 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:28.904220 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:28.904220 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:28.904220 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:28.904220 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:28.904220 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:27:28.904220 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:27:28.904220 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:27:28.905466 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:27:28.905466 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:27:28.905466 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:27:28.905466 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:27:28.905466 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:27:28.905466 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:27:28.905466 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:27:28.905466 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40a79ecf-b103-42e0-9cd6-d1daacb03f53 could not be found. Aug 01 14:27:28.905466 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:28.905466 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:28.905466 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:28.905466 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:28.905466 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:28.905466 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:28.905466 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:27:28.905466 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:27:28.905466 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40a79ecf-b103-42e0-9cd6-d1daacb03f53 could not be found. Aug 01 14:27:28.905466 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:28.908046 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-452b9eb9-4dd5-4faa-8939-7aa3e5a0cb0f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Returning 404 to user: Instance 40a79ecf-b103-42e0-9cd6-d1daacb03f53 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:27:28.909175 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-452b9eb9-4dd5-4faa-8939-7aa3e5a0cb0f tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53" status: 404 len: 111 microversion: 2.20 time: 0.060573 Aug 01 14:27:28.910233 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 487/962] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:28 2022] GET /compute/v2.1/servers/40a79ecf-b103-42e0-9cd6-d1daacb03f53 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:27:30.077882 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-dcb5b22c-d178-4725-8c71-2624fa00f158 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:30.079109 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-dcb5b22c-d178-4725-8c71-2624fa00f158 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:30.086164 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dcb5b22c-d178-4725-8c71-2624fa00f158 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:30.086927 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dcb5b22c-d178-4725-8c71-2624fa00f158 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:30.087962 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dcb5b22c-d178-4725-8c71-2624fa00f158 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:30.088615 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dcb5b22c-d178-4725-8c71-2624fa00f158 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:30.106164 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-dcb5b22c-d178-4725-8c71-2624fa00f158 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] HTTP exception thrown: Instance 76deb7da-88aa-4c26-b55d-fd6432d1e680 could not be found. Aug 01 14:27:30.107773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-dcb5b22c-d178-4725-8c71-2624fa00f158 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Request method failure captured: Aug 01 14:27:30.107773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: DELETE /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 HTTP/1.1 Aug 01 14:27:30.107773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:27:30.107773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:27:30.107773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:27:30.107773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 0 Aug 01 14:27:30.107773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:27:30.107773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:27:30.107773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:27:30.107773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:27:30.107773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-EnTXKMlVzWiQvuoM3Li_7Xt8e8pzyVSu3I8Ovwsb05jmHaJIhXIfloZhNdo4gAbu7GPWwvsJeTl480IhROVHmaghvN-qiUMKCq9B07l6XFEquo1vchDUYVb3d185Gvq7QLtXjaK73JfW_xulof1LYuTsbvm4u6bw3hZw57cR1h5ds Aug 01 14:27:30.107773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:27:30.107773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:27:30.107773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:27:30.107773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:27:30.107773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 14:27:30.107773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:27:30.107773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:27:30.107773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: 2fb1590048254549bb480d677892031f Aug 01 14:27:30.107773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-803629719 Aug 01 14:27:30.107773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:27:30.107773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:27:30.109175 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2fb1590048254549bb480d677892031f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2fb1590048254549bb480d677892031f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2fb1590048254549bb480d677892031f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2fb1590048254549bb480d677892031f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:27:30.109175 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-AttachVolumeShelveTestJSON-803629719 Aug 01 14:27:30.109175 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 2fb1590048254549bb480d677892031f Aug 01 14:27:30.109175 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-803629719 Aug 01 14:27:30.109175 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-AttachVolumeShelveTestJSON-803629719-project Aug 01 14:27:30.109175 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:27:30.109175 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:27:30.109175 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: fbaa67d901e34419b1616a8457fbd683 Aug 01 14:27:30.109175 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-AttachVolumeShelveTestJSON-803629719-project Aug 01 14:27:30.109175 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: > Aug 01 14:27:30.109175 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Instance 76deb7da-88aa-4c26-b55d-fd6432d1e680 could not be found. Aug 01 14:27:30.109175 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'id': '76deb7da-88aa-4c26-b55d-fd6432d1e680'} Aug 01 14:27:30.109926 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:27:30.109926 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:30.109926 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:27:30.109926 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:27:30.109926 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:27:30.109926 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:27:30.109926 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:27:30.109926 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:27:30.109926 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:27:30.109926 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:27:30.109926 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76deb7da-88aa-4c26-b55d-fd6432d1e680 could not be found. Aug 01 14:27:30.109926 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:30.109926 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:30.109926 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:30.109926 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:30.109926 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:30.109926 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:30.109926 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:27:30.109926 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:27:30.109926 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:27:30.111165 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:27:30.111165 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:27:30.111165 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:27:30.111165 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:27:30.111165 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:27:30.111165 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:27:30.111165 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:27:30.111165 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:27:30.111165 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:27:30.111165 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76deb7da-88aa-4c26-b55d-fd6432d1e680 could not be found. Aug 01 14:27:30.111165 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:30.111165 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:30.111165 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:30.111165 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:30.111165 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:30.111165 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:30.111165 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:27:30.111165 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:27:30.111165 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76deb7da-88aa-4c26-b55d-fd6432d1e680 could not be found. Aug 01 14:27:30.111165 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:30.112544 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-dcb5b22c-d178-4725-8c71-2624fa00f158 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Returning 404 to user: Instance 76deb7da-88aa-4c26-b55d-fd6432d1e680 could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:27:30.112544 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-dcb5b22c-d178-4725-8c71-2624fa00f158 tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "DELETE /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 404 len: 111 microversion: 2.20 time: 0.035789 Aug 01 14:27:30.112544 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 476/963] 10.222.0.17 () {60 vars in 1280 bytes} [Mon Aug 1 14:27:30 2022] DELETE /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:27:30.120181 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2ccbda34-d478-4598-b0da-63fa07f26c8a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:30.121503 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2ccbda34-d478-4598-b0da-63fa07f26c8a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] [instance: 76deb7da-88aa-4c26-b55d-fd6432d1e680] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:30.130653 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2ccbda34-d478-4598-b0da-63fa07f26c8a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:30.131234 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2ccbda34-d478-4598-b0da-63fa07f26c8a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:30.132354 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2ccbda34-d478-4598-b0da-63fa07f26c8a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:30.132901 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2ccbda34-d478-4598-b0da-63fa07f26c8a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:30.149909 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-2ccbda34-d478-4598-b0da-63fa07f26c8a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] HTTP exception thrown: Instance 76deb7da-88aa-4c26-b55d-fd6432d1e680 could not be found. Aug 01 14:27:30.151658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2ccbda34-d478-4598-b0da-63fa07f26c8a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Request method failure captured: Aug 01 14:27:30.151658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 HTTP/1.1 Aug 01 14:27:30.151658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept: application/json Aug 01 14:27:30.151658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Aug 01 14:27:30.151658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Connection: close Aug 01 14:27:30.151658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Length: 0 Aug 01 14:27:30.151658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Type: application/json Aug 01 14:27:30.151658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Host: 10.222.0.17 Aug 01 14:27:30.151658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Aug 01 14:27:30.151658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.10 Aug 01 14:27:30.151658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABi5-EnTXKMlVzWiQvuoM3Li_7Xt8e8pzyVSu3I8Ovwsb05jmHaJIhXIfloZhNdo4gAbu7GPWwvsJeTl480IhROVHmaghvN-qiUMKCq9B07l6XFEquo1vchDUYVb3d185Gvq7QLtXjaK73JfW_xulof1LYuTsbvm4u6bw3hZw57cR1h5ds Aug 01 14:27:30.151658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Aug 01 14:27:30.151658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Aug 01 14:27:30.151658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Aug 01 14:27:30.151658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Aug 01 14:27:30.151658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 14:27:30.151658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Aug 01 14:27:30.151658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Aug 01 14:27:30.151658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Id: 2fb1590048254549bb480d677892031f Aug 01 14:27:30.151658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-803629719 Aug 01 14:27:30.151658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Role: reader,member Aug 01 14:27:30.151658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Roles: reader,member Aug 01 14:27:30.154052 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2fb1590048254549bb480d677892031f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2fb1590048254549bb480d677892031f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2fb1590048254549bb480d677892031f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2fb1590048254549bb480d677892031f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:27:30.154052 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-AttachVolumeShelveTestJSON-803629719 Aug 01 14:27:30.154052 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 2fb1590048254549bb480d677892031f Aug 01 14:27:30.154052 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-803629719 Aug 01 14:27:30.154052 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User: tempest-AttachVolumeShelveTestJSON-803629719-project Aug 01 14:27:30.154052 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Aug 01 14:27:30.154052 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Aug 01 14:27:30.154052 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Id: fbaa67d901e34419b1616a8457fbd683 Aug 01 14:27:30.154052 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-AttachVolumeShelveTestJSON-803629719-project Aug 01 14:27:30.154052 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: method: > Aug 01 14:27:30.154052 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: exception: Instance 76deb7da-88aa-4c26-b55d-fd6432d1e680 could not be found. Aug 01 14:27:30.154052 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: action_args: {'id': '76deb7da-88aa-4c26-b55d-fd6432d1e680'} Aug 01 14:27:30.154906 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:27:30.154906 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:30.154906 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:27:30.154906 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:27:30.154906 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:27:30.154906 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:27:30.154906 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:27:30.154906 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:27:30.154906 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:27:30.154906 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:27:30.154906 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76deb7da-88aa-4c26-b55d-fd6432d1e680 could not be found. Aug 01 14:27:30.154906 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:30.154906 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:30.154906 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:30.154906 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:30.154906 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:30.154906 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:30.154906 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:27:30.154906 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:27:30.154906 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:27:30.156371 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:27:30.156371 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:27:30.156371 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:27:30.156371 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:27:30.156371 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:27:30.156371 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:27:30.156371 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:27:30.156371 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76deb7da-88aa-4c26-b55d-fd6432d1e680 could not be found. Aug 01 14:27:30.156371 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:30.156371 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:30.156371 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:30.156371 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:30.156371 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:30.156371 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:30.156371 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:27:30.156371 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:27:30.156371 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76deb7da-88aa-4c26-b55d-fd6432d1e680 could not be found. Aug 01 14:27:30.156371 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:30.158361 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2ccbda34-d478-4598-b0da-63fa07f26c8a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] Returning 404 to user: Instance 76deb7da-88aa-4c26-b55d-fd6432d1e680 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:27:30.159480 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2ccbda34-d478-4598-b0da-63fa07f26c8a tempest-AttachVolumeShelveTestJSON-803629719 tempest-AttachVolumeShelveTestJSON-803629719-project] 10.222.0.17 "GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680" status: 404 len: 111 microversion: 2.20 time: 0.044427 Aug 01 14:27:30.163956 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 488/964] 10.222.0.17 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:30 2022] GET /compute/v2.1/servers/76deb7da-88aa-4c26-b55d-fd6432d1e680 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:27:36.889612 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c8633b15-2e00-4e56-b94f-97799ff48e1a tempest-VolumesNegativeTest-614611912 tempest-VolumesNegativeTest-614611912-project] Action: 'create', calling method: .version_select at 0x7f6185553ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1901504215", "metadata": {"Type": "work"}}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:27:36.909126 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c8633b15-2e00-4e56-b94f-97799ff48e1a tempest-VolumesNegativeTest-614611912 tempest-VolumesNegativeTest-614611912-project] Request method failure captured: Aug 01 14:27:36.909126 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 14:27:36.909126 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:27:36.909126 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:27:36.909126 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:27:36.909126 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 122 Aug 01 14:27:36.909126 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:27:36.909126 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:27:36.909126 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:27:36.909126 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:27:36.909126 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-LY1n9GPGfS7Xw1m_pQBx4oGspZdPQeo0pkdxrP8RFEFElm62ykQVsnktA7BGX4fgzzfCmffbYVl3geNrzYBMpgKuKy6GCrwk_dcKfSJh_-gHKoq6CULYW8JSbcBESLgwr1BawC7mhe-TrGOVLCoYHh1oNaEBDfRFlk7mXb7--Zf6A Aug 01 14:27:36.909126 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:27:36.909126 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:27:36.909126 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:27:36.909126 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:27:36.909126 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:27:36.909126 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:27:36.909126 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: 99305bda3fe54f93a570e0786a0fcc03 Aug 01 14:27:36.909126 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-VolumesNegativeTest-614611912 Aug 01 14:27:36.909126 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:27:36.909126 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:27:36.910845 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99305bda3fe54f93a570e0786a0fcc03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/99305bda3fe54f93a570e0786a0fcc03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99305bda3fe54f93a570e0786a0fcc03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_99305bda3fe54f93a570e0786a0fcc03", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:27:36.910845 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-VolumesNegativeTest-614611912 Aug 01 14:27:36.910845 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 99305bda3fe54f93a570e0786a0fcc03 Aug 01 14:27:36.910845 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-VolumesNegativeTest-614611912 Aug 01 14:27:36.910845 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-VolumesNegativeTest-614611912-project Aug 01 14:27:36.910845 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:27:36.910845 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:27:36.910845 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: 96c44bd22d0145fd8836e4d2cd3f17a1 Aug 01 14:27:36.910845 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-VolumesNegativeTest-614611912-project Aug 01 14:27:36.910845 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Aug 01 14:27:36.910845 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1901504215", "metadata": {"Type": "work"}}} Aug 01 14:27:36.910845 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: Aug 01 14:27:36.910845 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 14:27:36.911865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1901504215', 'metadata': {'Type': 'work'}}}} Aug 01 14:27:36.911865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:27:36.911865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:36.911865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 14:27:36.911865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 14:27:36.911865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 14:27:36.911865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise error Aug 01 14:27:36.911865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 01 14:27:36.911865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:36.911865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 01 14:27:36.911865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 14:27:36.911865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:36.911865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 14:27:36.911865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi '#$%' Aug 01 14:27:36.911865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:36.911865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:36.911865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:36.911865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:36.911865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:36.911865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:36.911865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:27:36.911865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:27:36.913446 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:27:36.913446 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:27:36.913446 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:27:36.913446 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:27:36.913446 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 14:27:36.913446 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 14:27:36.913446 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 14:27:36.913446 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 14:27:36.913446 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 14:27:36.913446 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 14:27:36.913446 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 14:27:36.913446 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:36.913446 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:36.913446 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:36.913446 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:36.913446 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:36.913446 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:36.913446 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 14:27:36.913446 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 14:27:36.915109 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 14:27:36.915109 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:36.916176 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c8633b15-2e00-4e56-b94f-97799ff48e1a tempest-VolumesNegativeTest-614611912 tempest-VolumesNegativeTest-614611912-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:27:36.918103 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c8633b15-2e00-4e56-b94f-97799ff48e1a tempest-VolumesNegativeTest-614611912 tempest-VolumesNegativeTest-614611912-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.153126 Aug 01 14:27:36.918816 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 477/965] 10.222.0.17 () {60 vars in 1156 bytes} [Mon Aug 1 14:27:36 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:27:36.929534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-92e73ee4-d61f-4fa8-9945-1075e4bfede7 tempest-VolumesNegativeTest-614611912 tempest-VolumesNegativeTest-614611912-project] Action: 'create', calling method: .version_select at 0x7f6184b87dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1813481654", "metadata": {"Type": "work"}}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:27:36.936897 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-92e73ee4-d61f-4fa8-9945-1075e4bfede7 tempest-VolumesNegativeTest-614611912 tempest-VolumesNegativeTest-614611912-project] Request method failure captured: Aug 01 14:27:36.936897 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 14:27:36.936897 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept: application/json Aug 01 14:27:36.936897 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Aug 01 14:27:36.936897 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Connection: close Aug 01 14:27:36.936897 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Length: 120 Aug 01 14:27:36.936897 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Type: application/json Aug 01 14:27:36.936897 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Host: 10.222.0.17 Aug 01 14:27:36.936897 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Aug 01 14:27:36.936897 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.10 Aug 01 14:27:36.936897 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABi5-LY1n9GPGfS7Xw1m_pQBx4oGspZdPQeo0pkdxrP8RFEFElm62ykQVsnktA7BGX4fgzzfCmffbYVl3geNrzYBMpgKuKy6GCrwk_dcKfSJh_-gHKoq6CULYW8JSbcBESLgwr1BawC7mhe-TrGOVLCoYHh1oNaEBDfRFlk7mXb7--Zf6A Aug 01 14:27:36.936897 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Aug 01 14:27:36.936897 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Aug 01 14:27:36.936897 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Aug 01 14:27:36.936897 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Aug 01 14:27:36.936897 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Aug 01 14:27:36.936897 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Aug 01 14:27:36.936897 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Id: 99305bda3fe54f93a570e0786a0fcc03 Aug 01 14:27:36.936897 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-VolumesNegativeTest-614611912 Aug 01 14:27:36.936897 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Role: reader,member Aug 01 14:27:36.936897 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Roles: reader,member Aug 01 14:27:36.938434 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99305bda3fe54f93a570e0786a0fcc03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/99305bda3fe54f93a570e0786a0fcc03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99305bda3fe54f93a570e0786a0fcc03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_99305bda3fe54f93a570e0786a0fcc03", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:27:36.938434 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-VolumesNegativeTest-614611912 Aug 01 14:27:36.938434 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 99305bda3fe54f93a570e0786a0fcc03 Aug 01 14:27:36.938434 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-VolumesNegativeTest-614611912 Aug 01 14:27:36.938434 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User: tempest-VolumesNegativeTest-614611912-project Aug 01 14:27:36.938434 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Aug 01 14:27:36.938434 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Aug 01 14:27:36.938434 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Id: 96c44bd22d0145fd8836e4d2cd3f17a1 Aug 01 14:27:36.938434 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-VolumesNegativeTest-614611912-project Aug 01 14:27:36.938434 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Aug 01 14:27:36.938434 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1813481654", "metadata": {"Type": "work"}}} Aug 01 14:27:36.938434 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: method: Aug 01 14:27:36.938434 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 14:27:36.939483 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1813481654', 'metadata': {'Type': 'work'}}}} Aug 01 14:27:36.939483 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:27:36.939483 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:36.939483 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 14:27:36.939483 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 14:27:36.939483 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 14:27:36.939483 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise error Aug 01 14:27:36.939483 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 01 14:27:36.939483 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:36.939483 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 01 14:27:36.939483 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 14:27:36.939483 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:36.939483 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 14:27:36.939483 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi '0' Aug 01 14:27:36.939483 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:36.939483 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:36.939483 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:36.939483 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:36.939483 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:36.939483 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:36.939483 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:27:36.939483 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:27:36.940776 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:27:36.940776 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:27:36.940776 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:27:36.940776 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:27:36.940776 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 14:27:36.940776 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 14:27:36.940776 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 14:27:36.940776 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 14:27:36.940776 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 14:27:36.940776 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 14:27:36.940776 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 14:27:36.940776 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:36.940776 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:36.940776 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:36.940776 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:36.940776 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:36.940776 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:36.940776 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 14:27:36.940776 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 14:27:36.941861 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 14:27:36.941861 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:36.943890 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-92e73ee4-d61f-4fa8-9945-1075e4bfede7 tempest-VolumesNegativeTest-614611912 tempest-VolumesNegativeTest-614611912-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:27:36.944873 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-92e73ee4-d61f-4fa8-9945-1075e4bfede7 tempest-VolumesNegativeTest-614611912 tempest-VolumesNegativeTest-614611912-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020895 Aug 01 14:27:36.945432 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 489/966] 10.222.0.17 () {60 vars in 1156 bytes} [Mon Aug 1 14:27:36 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:27:36.958718 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-faa611b6-1e3a-471c-8e83-a0703a0274e8 tempest-VolumesNegativeTest-614611912 tempest-VolumesNegativeTest-614611912-project] Action: 'create', calling method: .version_select at 0x7f6185541ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1298082250", "metadata": {"Type": "work"}}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:27:36.962347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-faa611b6-1e3a-471c-8e83-a0703a0274e8 tempest-VolumesNegativeTest-614611912 tempest-VolumesNegativeTest-614611912-project] Request method failure captured: Aug 01 14:27:36.962347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 14:27:36.962347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:27:36.962347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:27:36.962347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:27:36.962347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 119 Aug 01 14:27:36.962347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:27:36.962347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:27:36.962347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:27:36.962347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:27:36.962347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-LY1n9GPGfS7Xw1m_pQBx4oGspZdPQeo0pkdxrP8RFEFElm62ykQVsnktA7BGX4fgzzfCmffbYVl3geNrzYBMpgKuKy6GCrwk_dcKfSJh_-gHKoq6CULYW8JSbcBESLgwr1BawC7mhe-TrGOVLCoYHh1oNaEBDfRFlk7mXb7--Zf6A Aug 01 14:27:36.962347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:27:36.962347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:27:36.962347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:27:36.962347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:27:36.962347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:27:36.962347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:27:36.962347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: 99305bda3fe54f93a570e0786a0fcc03 Aug 01 14:27:36.962347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-VolumesNegativeTest-614611912 Aug 01 14:27:36.962347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:27:36.962347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:27:36.963798 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99305bda3fe54f93a570e0786a0fcc03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/99305bda3fe54f93a570e0786a0fcc03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99305bda3fe54f93a570e0786a0fcc03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_99305bda3fe54f93a570e0786a0fcc03", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:27:36.963798 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-VolumesNegativeTest-614611912 Aug 01 14:27:36.963798 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 99305bda3fe54f93a570e0786a0fcc03 Aug 01 14:27:36.963798 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-VolumesNegativeTest-614611912 Aug 01 14:27:36.963798 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-VolumesNegativeTest-614611912-project Aug 01 14:27:36.963798 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:27:36.963798 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:27:36.963798 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: 96c44bd22d0145fd8836e4d2cd3f17a1 Aug 01 14:27:36.963798 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-VolumesNegativeTest-614611912-project Aug 01 14:27:36.963798 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Aug 01 14:27:36.963798 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1298082250", "metadata": {"Type": "work"}}} Aug 01 14:27:36.963798 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: Aug 01 14:27:36.963798 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 14:27:36.969120 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1298082250', 'metadata': {'Type': 'work'}}}} Aug 01 14:27:36.969120 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:27:36.969120 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:36.969120 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 14:27:36.969120 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 14:27:36.969120 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 14:27:36.969120 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise error Aug 01 14:27:36.969120 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 01 14:27:36.969120 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:36.969120 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 01 14:27:36.969120 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 14:27:36.969120 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:36.969120 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 14:27:36.969120 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi '' Aug 01 14:27:36.969120 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:36.969120 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:36.969120 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:36.969120 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:36.969120 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:36.969120 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:36.969120 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:27:36.969120 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:27:36.970668 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:27:36.970668 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:27:36.970668 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:27:36.970668 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:27:36.970668 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 14:27:36.970668 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 14:27:36.970668 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 14:27:36.970668 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 14:27:36.970668 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 14:27:36.970668 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 14:27:36.970668 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 14:27:36.970668 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:36.970668 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:36.970668 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:36.970668 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:36.970668 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:36.970668 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:36.970668 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 14:27:36.970668 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 14:27:36.972080 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 14:27:36.972080 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:36.972080 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-faa611b6-1e3a-471c-8e83-a0703a0274e8 tempest-VolumesNegativeTest-614611912 tempest-VolumesNegativeTest-614611912-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:27:36.972080 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-faa611b6-1e3a-471c-8e83-a0703a0274e8 tempest-VolumesNegativeTest-614611912 tempest-VolumesNegativeTest-614611912-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012710 Aug 01 14:27:36.972080 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 478/967] 10.222.0.17 () {60 vars in 1156 bytes} [Mon Aug 1 14:27:36 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 01 14:27:36.978157 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-279b7aa1-462e-4127-ad63-77a36fbdba4d tempest-VolumesNegativeTest-614611912 tempest-VolumesNegativeTest-614611912-project] Calling method '.version_select at 0x7f6184c9b0d0>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:37.015967 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-279b7aa1-462e-4127-ad63-77a36fbdba4d tempest-VolumesNegativeTest-614611912 tempest-VolumesNegativeTest-614611912-project] HTTP exception thrown: Volume tempest-invalid-889741740 could not be found. Aug 01 14:27:37.018472 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-279b7aa1-462e-4127-ad63-77a36fbdba4d tempest-VolumesNegativeTest-614611912 tempest-VolumesNegativeTest-614611912-project] Request method failure captured: Aug 01 14:27:37.018472 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-889741740 HTTP/1.1 Aug 01 14:27:37.018472 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept: application/json Aug 01 14:27:37.018472 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Aug 01 14:27:37.018472 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Connection: close Aug 01 14:27:37.018472 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Length: 0 Aug 01 14:27:37.018472 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Type: application/json Aug 01 14:27:37.018472 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Host: 10.222.0.17 Aug 01 14:27:37.018472 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Aug 01 14:27:37.018472 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.10 Aug 01 14:27:37.018472 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABi5-LY1n9GPGfS7Xw1m_pQBx4oGspZdPQeo0pkdxrP8RFEFElm62ykQVsnktA7BGX4fgzzfCmffbYVl3geNrzYBMpgKuKy6GCrwk_dcKfSJh_-gHKoq6CULYW8JSbcBESLgwr1BawC7mhe-TrGOVLCoYHh1oNaEBDfRFlk7mXb7--Zf6A Aug 01 14:27:37.018472 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Aug 01 14:27:37.018472 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Aug 01 14:27:37.018472 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Aug 01 14:27:37.018472 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Aug 01 14:27:37.018472 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Aug 01 14:27:37.018472 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Aug 01 14:27:37.018472 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Id: 99305bda3fe54f93a570e0786a0fcc03 Aug 01 14:27:37.018472 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-VolumesNegativeTest-614611912 Aug 01 14:27:37.018472 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Role: reader,member Aug 01 14:27:37.018472 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Roles: reader,member Aug 01 14:27:37.019983 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99305bda3fe54f93a570e0786a0fcc03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/99305bda3fe54f93a570e0786a0fcc03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99305bda3fe54f93a570e0786a0fcc03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_99305bda3fe54f93a570e0786a0fcc03", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:27:37.019983 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-VolumesNegativeTest-614611912 Aug 01 14:27:37.019983 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 99305bda3fe54f93a570e0786a0fcc03 Aug 01 14:27:37.019983 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-VolumesNegativeTest-614611912 Aug 01 14:27:37.019983 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User: tempest-VolumesNegativeTest-614611912-project Aug 01 14:27:37.019983 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Aug 01 14:27:37.019983 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Aug 01 14:27:37.019983 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Id: 96c44bd22d0145fd8836e4d2cd3f17a1 Aug 01 14:27:37.019983 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-VolumesNegativeTest-614611912-project Aug 01 14:27:37.019983 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: method: Aug 01 14:27:37.019983 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: exception: Volume tempest-invalid-889741740 could not be found. Aug 01 14:27:37.019983 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: action_args: {'id': 'tempest-invalid-889741740'} Aug 01 14:27:37.019983 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:27:37.021425 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:37.021425 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:27:37.021425 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:27:37.021425 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 14:27:37.021425 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 14:27:37.021425 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 14:27:37.021425 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 14:27:37.021425 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 14:27:37.021425 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 14:27:37.021425 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 14:27:37.021425 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 14:27:37.021425 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:27:37.021425 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:27:37.021425 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:27:37.021425 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:27:37.021425 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-889741740 could not be found. (HTTP 404) (Request-ID: req-51c8ccd1-1b97-4b3b-b31f-e085d24e9203) Aug 01 14:27:37.021425 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:37.021425 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:37.021425 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:37.022700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:37.022700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 14:27:37.022700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 14:27:37.022700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:27:37.022700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:27:37.022700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 14:27:37.022700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 14:27:37.022700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:27:37.022700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:27:37.022700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:27:37.022700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:27:37.022700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 14:27:37.022700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 14:27:37.022700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 14:27:37.022700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 14:27:37.022700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 14:27:37.022700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 14:27:37.022700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 14:27:37.022700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 14:27:37.025620 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:27:37.025620 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:27:37.025620 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:27:37.025620 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:27:37.025620 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-889741740 could not be found. Aug 01 14:27:37.025620 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:37.025620 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:37.025620 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:37.025620 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:37.025620 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:37.025620 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:37.025620 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:27:37.025620 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:27:37.025620 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:27:37.025620 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:27:37.025620 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:27:37.025620 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:27:37.025620 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 14:27:37.025620 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:27:37.025620 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-889741740 could not be found. Aug 01 14:27:37.028000 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:37.028000 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:37.028000 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:37.028000 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:37.028000 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:37.028000 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:37.028000 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:27:37.028000 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:27:37.028000 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-889741740 could not be found. Aug 01 14:27:37.028000 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:37.028000 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-279b7aa1-462e-4127-ad63-77a36fbdba4d tempest-VolumesNegativeTest-614611912 tempest-VolumesNegativeTest-614611912-project] Returning 404 to user: Volume tempest-invalid-889741740 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:27:37.028000 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-279b7aa1-462e-4127-ad63-77a36fbdba4d tempest-VolumesNegativeTest-614611912 tempest-VolumesNegativeTest-614611912-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-889741740" status: 404 len: 98 microversion: 2.1 time: 0.049335 Aug 01 14:27:37.028000 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 490/968] 10.222.0.17 () {58 vars in 1215 bytes} [Mon Aug 1 14:27:36 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-889741740 => generated 98 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 01 14:27:37.036007 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5adf5b2a-62cd-4dc1-8809-3bad8fee8831 tempest-VolumesNegativeTest-614611912 tempest-VolumesNegativeTest-614611912-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006018 Aug 01 14:27:37.037130 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 479/969] 10.222.0.17 () {58 vars in 1140 bytes} [Mon Aug 1 14:27:37 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 01 14:27:37.048026 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-156007db-213b-407d-8ab2-521edc3431d4 tempest-VolumesNegativeTest-614611912 tempest-VolumesNegativeTest-614611912-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003915 Aug 01 14:27:37.048880 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 491/970] 10.222.0.17 () {58 vars in 1137 bytes} [Mon Aug 1 14:27:37 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 01 14:27:37.072021 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-77361b91-63e2-48b5-809b-e19af03a0441 tempest-VolumesNegativeTest-614611912 tempest-VolumesNegativeTest-614611912-project] Calling method '.version_select at 0x7f6189c1d820>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:37.102199 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-77361b91-63e2-48b5-809b-e19af03a0441 tempest-VolumesNegativeTest-614611912 tempest-VolumesNegativeTest-614611912-project] HTTP exception thrown: Volume 7bc7987e-e73c-4bec-9120-8c6d691e4f94 could not be found. Aug 01 14:27:37.104289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-77361b91-63e2-48b5-809b-e19af03a0441 tempest-VolumesNegativeTest-614611912 tempest-VolumesNegativeTest-614611912-project] Request method failure captured: Aug 01 14:27:37.104289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: DELETE /compute/v2.1/os-volumes/7bc7987e-e73c-4bec-9120-8c6d691e4f94 HTTP/1.1 Aug 01 14:27:37.104289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:27:37.104289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:27:37.104289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:27:37.104289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 0 Aug 01 14:27:37.104289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:27:37.104289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:27:37.104289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:27:37.104289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:27:37.104289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-LY1n9GPGfS7Xw1m_pQBx4oGspZdPQeo0pkdxrP8RFEFElm62ykQVsnktA7BGX4fgzzfCmffbYVl3geNrzYBMpgKuKy6GCrwk_dcKfSJh_-gHKoq6CULYW8JSbcBESLgwr1BawC7mhe-TrGOVLCoYHh1oNaEBDfRFlk7mXb7--Zf6A Aug 01 14:27:37.104289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:27:37.104289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:27:37.104289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:27:37.104289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:27:37.104289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:27:37.104289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:27:37.104289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: 99305bda3fe54f93a570e0786a0fcc03 Aug 01 14:27:37.104289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-VolumesNegativeTest-614611912 Aug 01 14:27:37.104289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:27:37.104289 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:27:37.106207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99305bda3fe54f93a570e0786a0fcc03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/99305bda3fe54f93a570e0786a0fcc03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99305bda3fe54f93a570e0786a0fcc03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_99305bda3fe54f93a570e0786a0fcc03", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:27:37.106207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-VolumesNegativeTest-614611912 Aug 01 14:27:37.106207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 99305bda3fe54f93a570e0786a0fcc03 Aug 01 14:27:37.106207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-VolumesNegativeTest-614611912 Aug 01 14:27:37.106207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-VolumesNegativeTest-614611912-project Aug 01 14:27:37.106207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:27:37.106207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:27:37.106207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: 96c44bd22d0145fd8836e4d2cd3f17a1 Aug 01 14:27:37.106207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-VolumesNegativeTest-614611912-project Aug 01 14:27:37.106207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: Aug 01 14:27:37.106207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Volume 7bc7987e-e73c-4bec-9120-8c6d691e4f94 could not be found. Aug 01 14:27:37.106207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'id': '7bc7987e-e73c-4bec-9120-8c6d691e4f94'} Aug 01 14:27:37.106207 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:27:37.106985 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:37.106985 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:27:37.106985 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:27:37.106985 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 14:27:37.106985 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 14:27:37.106985 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 14:27:37.106985 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 14:27:37.106985 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 14:27:37.106985 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 14:27:37.106985 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 14:27:37.106985 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 14:27:37.106985 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:27:37.106985 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:27:37.106985 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:27:37.106985 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:27:37.106985 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7bc7987e-e73c-4bec-9120-8c6d691e4f94 could not be found. (HTTP 404) (Request-ID: req-9c2365fe-1f85-45d6-9f24-87e150b00ade) Aug 01 14:27:37.106985 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:37.106985 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:37.106985 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:37.108107 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:37.108107 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 14:27:37.108107 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 14:27:37.108107 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:27:37.108107 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:27:37.108107 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 14:27:37.108107 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 14:27:37.108107 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:27:37.108107 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:27:37.108107 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:27:37.108107 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:27:37.108107 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 14:27:37.108107 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 14:27:37.108107 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 14:27:37.108107 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 14:27:37.108107 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 14:27:37.108107 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 14:27:37.108107 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 14:27:37.108107 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 14:27:37.109235 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:27:37.109235 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:27:37.109235 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:27:37.109235 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:27:37.109235 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7bc7987e-e73c-4bec-9120-8c6d691e4f94 could not be found. Aug 01 14:27:37.109235 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:37.109235 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:37.109235 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:37.109235 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:37.109235 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:37.109235 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:37.109235 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:27:37.109235 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:27:37.109235 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:27:37.109235 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:27:37.109235 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:27:37.109235 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:27:37.109235 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 14:27:37.109235 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:27:37.110426 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7bc7987e-e73c-4bec-9120-8c6d691e4f94 could not be found. Aug 01 14:27:37.110426 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:37.110426 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:37.110426 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:37.110426 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:37.110426 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:37.110426 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:37.110426 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:27:37.110426 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:27:37.110426 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7bc7987e-e73c-4bec-9120-8c6d691e4f94 could not be found. Aug 01 14:27:37.110426 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:27:37.110426 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-77361b91-63e2-48b5-809b-e19af03a0441 tempest-VolumesNegativeTest-614611912 tempest-VolumesNegativeTest-614611912-project] Returning 404 to user: Volume 7bc7987e-e73c-4bec-9120-8c6d691e4f94 could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:27:37.110426 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-77361b91-63e2-48b5-809b-e19af03a0441 tempest-VolumesNegativeTest-614611912 tempest-VolumesNegativeTest-614611912-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/7bc7987e-e73c-4bec-9120-8c6d691e4f94" status: 404 len: 109 microversion: 2.1 time: 0.047933 Aug 01 14:27:37.110426 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 480/971] 10.222.0.17 () {58 vars in 1248 bytes} [Mon Aug 1 14:27:37 2022] DELETE /compute/v2.1/os-volumes/7bc7987e-e73c-4bec-9120-8c6d691e4f94 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:27:37.119324 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4f82688c-c168-4d58-82a0-87064d692cc4 tempest-VolumesNegativeTest-614611912 tempest-VolumesNegativeTest-614611912-project] Calling method '.version_select at 0x7f6184c9ab80>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:37.154165 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-4f82688c-c168-4d58-82a0-87064d692cc4 tempest-VolumesNegativeTest-614611912 tempest-VolumesNegativeTest-614611912-project] HTTP exception thrown: Volume b943a791-9357-4237-8c3b-63c9aae06ade could not be found. Aug 01 14:27:37.156150 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4f82688c-c168-4d58-82a0-87064d692cc4 tempest-VolumesNegativeTest-614611912 tempest-VolumesNegativeTest-614611912-project] Request method failure captured: Aug 01 14:27:37.156150 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/os-volumes/b943a791-9357-4237-8c3b-63c9aae06ade HTTP/1.1 Aug 01 14:27:37.156150 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept: application/json Aug 01 14:27:37.156150 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Aug 01 14:27:37.156150 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Connection: close Aug 01 14:27:37.156150 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Length: 0 Aug 01 14:27:37.156150 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Type: application/json Aug 01 14:27:37.156150 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Host: 10.222.0.17 Aug 01 14:27:37.156150 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Aug 01 14:27:37.156150 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.10 Aug 01 14:27:37.156150 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABi5-LY1n9GPGfS7Xw1m_pQBx4oGspZdPQeo0pkdxrP8RFEFElm62ykQVsnktA7BGX4fgzzfCmffbYVl3geNrzYBMpgKuKy6GCrwk_dcKfSJh_-gHKoq6CULYW8JSbcBESLgwr1BawC7mhe-TrGOVLCoYHh1oNaEBDfRFlk7mXb7--Zf6A Aug 01 14:27:37.156150 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Aug 01 14:27:37.156150 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Aug 01 14:27:37.156150 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Aug 01 14:27:37.156150 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Aug 01 14:27:37.156150 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Aug 01 14:27:37.156150 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Aug 01 14:27:37.156150 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Id: 99305bda3fe54f93a570e0786a0fcc03 Aug 01 14:27:37.156150 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-VolumesNegativeTest-614611912 Aug 01 14:27:37.156150 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Role: reader,member Aug 01 14:27:37.156150 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Roles: reader,member Aug 01 14:27:37.157510 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99305bda3fe54f93a570e0786a0fcc03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/99305bda3fe54f93a570e0786a0fcc03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/99305bda3fe54f93a570e0786a0fcc03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_99305bda3fe54f93a570e0786a0fcc03", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:27:37.157510 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-VolumesNegativeTest-614611912 Aug 01 14:27:37.157510 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 99305bda3fe54f93a570e0786a0fcc03 Aug 01 14:27:37.157510 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-VolumesNegativeTest-614611912 Aug 01 14:27:37.157510 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User: tempest-VolumesNegativeTest-614611912-project Aug 01 14:27:37.157510 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Aug 01 14:27:37.157510 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Aug 01 14:27:37.157510 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Id: 96c44bd22d0145fd8836e4d2cd3f17a1 Aug 01 14:27:37.157510 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-VolumesNegativeTest-614611912-project Aug 01 14:27:37.157510 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: method: Aug 01 14:27:37.157510 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: exception: Volume b943a791-9357-4237-8c3b-63c9aae06ade could not be found. Aug 01 14:27:37.157510 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: action_args: {'id': 'b943a791-9357-4237-8c3b-63c9aae06ade'} Aug 01 14:27:37.157510 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:27:37.158335 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:37.158335 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:27:37.158335 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:27:37.158335 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:27:37.158335 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:27:37.158335 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:27:37.158335 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:27:37.158335 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:27:37.158335 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:27:37.158335 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:27:37.158335 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:27:37.158335 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:27:37.158335 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:27:37.158335 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:27:37.158335 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:27:37.158335 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b943a791-9357-4237-8c3b-63c9aae06ade could not be found. (HTTP 404) (Request-ID: req-0112b512-e3bc-4b9d-9255-ade0e1b15716) Aug 01 14:27:37.158335 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:37.158335 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:37.158335 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:37.160534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:37.160534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 14:27:37.160534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 14:27:37.160534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:27:37.160534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:27:37.160534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 14:27:37.160534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 14:27:37.160534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:27:37.160534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:27:37.160534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:27:37.160534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:27:37.160534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:27:37.160534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:27:37.160534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:27:37.160534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:27:37.160534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:27:37.160534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:27:37.160534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:27:37.160534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:27:37.161795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:27:37.161795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:27:37.161795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:27:37.161795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:27:37.161795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b943a791-9357-4237-8c3b-63c9aae06ade could not be found. Aug 01 14:27:37.161795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:37.161795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:37.161795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:37.161795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:37.161795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:37.161795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:37.161795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:27:37.161795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:27:37.161795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:27:37.161795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:27:37.161795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:27:37.161795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:27:37.161795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 14:27:37.161795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:27:37.163422 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b943a791-9357-4237-8c3b-63c9aae06ade could not be found. Aug 01 14:27:37.163422 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:37.163422 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:37.163422 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:37.163422 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:37.163422 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:37.163422 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:37.163422 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:27:37.163422 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:27:37.163422 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b943a791-9357-4237-8c3b-63c9aae06ade could not be found. Aug 01 14:27:37.163422 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:27:37.163422 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4f82688c-c168-4d58-82a0-87064d692cc4 tempest-VolumesNegativeTest-614611912 tempest-VolumesNegativeTest-614611912-project] Returning 404 to user: Volume b943a791-9357-4237-8c3b-63c9aae06ade could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:27:37.163422 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4f82688c-c168-4d58-82a0-87064d692cc4 tempest-VolumesNegativeTest-614611912 tempest-VolumesNegativeTest-614611912-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/b943a791-9357-4237-8c3b-63c9aae06ade" status: 404 len: 109 microversion: 2.1 time: 0.042521 Aug 01 14:27:37.163422 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 492/972] 10.222.0.17 () {58 vars in 1245 bytes} [Mon Aug 1 14:27:37 2022] GET /compute/v2.1/os-volumes/b943a791-9357-4237-8c3b-63c9aae06ade => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:27:48.750582 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:48.751386 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=6 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:48.942740 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-137bc9b8-53e9-4c07-acd8-33182a589d23 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Action: 'create', calling method: .version_select at 0x7f61860dba60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-89656764", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGahW0trSdPbH9ioUZFS5Qxomy9UOlQ92vRYfmlTCdFC6q6uuqm2abiY6v8qyT//hkTl5+zHr97Jm34PYwiwtx5s0Zqzj3s12F5Rc3fzLqeR+deK2kP7/8sJwRhuFCypw=="}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:27:48.961521 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-137bc9b8-53e9-4c07-acd8-33182a589d23 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Getting quotas for project 47e500c5985743a2a5abfb99c0f42ab7. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:27:48.966450 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-137bc9b8-53e9-4c07-acd8-33182a589d23 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Getting quotas for user 540bec8413b144889a07e9d9458b298e and project 47e500c5985743a2a5abfb99c0f42ab7. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:27:48.998780 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-137bc9b8-53e9-4c07-acd8-33182a589d23 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.249578 Aug 01 14:27:48.999389 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 481/973] 10.222.0.17 () {60 vars in 1159 bytes} [Mon Aug 1 14:27:48 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:28:07.823875 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:07.824783 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:07.830180 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2e818ae9-16bf-4eab-a91a-a777e641ca3d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1131643391", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-89656764", "security_groups": [{"name": "tempest-secgroup-smoke-107218195"}], "block_device_mapping_v2": [{"uuid": "af5eb09d-ad9d-4687-9a26-8d33a3e9242f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "be2b1497-5181-491f-9b7c-a16c7782ef71"}]}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:28:08.047437 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.network.neutron [None req-2e818ae9-16bf-4eab-a91a-a777e641ca3d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] validate_networks() for [('be2b1497-5181-491f-9b7c-a16c7782ef71', None, None, None, None, None)] {{(pid=118132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:28:08.509871 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-2e818ae9-16bf-4eab-a91a-a777e641ca3d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Flavor limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:28:08.510293 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-2e818ae9-16bf-4eab-a91a-a777e641ca3d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Image limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:28:08.511321 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-2e818ae9-16bf-4eab-a91a-a777e641ca3d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Flavor pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:28:08.511763 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-2e818ae9-16bf-4eab-a91a-a777e641ca3d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Image pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:28:08.512309 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-2e818ae9-16bf-4eab-a91a-a777e641ca3d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:28:08.523886 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2e818ae9-16bf-4eab-a91a-a777e641ca3d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:08.524363 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2e818ae9-16bf-4eab-a91a-a777e641ca3d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:08.525170 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2e818ae9-16bf-4eab-a91a-a777e641ca3d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:08.525616 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2e818ae9-16bf-4eab-a91a-a777e641ca3d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:08.545409 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-2e818ae9-16bf-4eab-a91a-a777e641ca3d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Getting quotas for project 47e500c5985743a2a5abfb99c0f42ab7. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:28:08.553248 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-2e818ae9-16bf-4eab-a91a-a777e641ca3d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Getting quotas for user 540bec8413b144889a07e9d9458b298e and project 47e500c5985743a2a5abfb99c0f42ab7. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:28:08.616798 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2e818ae9-16bf-4eab-a91a-a777e641ca3d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Going to run 1 instances... {{(pid=118132) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:28:08.619015 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2e818ae9-16bf-4eab-a91a-a777e641ca3d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: fb882cc8-dad4-4898-9d57-ba546c8b1068] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='af5eb09d-ad9d-4687-9a26-8d33a3e9242f',volume_size=None,volume_type=None)] {{(pid=118132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:28:08.804872 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2e818ae9-16bf-4eab-a91a-a777e641ca3d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.982111 Aug 01 14:28:08.811663 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 493/974] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Aug 1 14:28:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:28:08.814691 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=4 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:08.815436 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:08.820158 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9d2df861-a840-488f-9b0d-524a2fc9b939 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:08.820776 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9d2df861-a840-488f-9b0d-524a2fc9b939 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: fb882cc8-dad4-4898-9d57-ba546c8b1068] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:08.914279 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9d2df861-a840-488f-9b0d-524a2fc9b939 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:08.925839 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9d2df861-a840-488f-9b0d-524a2fc9b939 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068" status: 200 len: 1093 microversion: 2.1 time: 0.112384 Aug 01 14:28:08.927088 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 482/975] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:08 2022] GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068 => generated 1093 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:09.373357 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-cb0c8799-4041-4d22-a114-25af528ef0f1 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:09.374662 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-cb0c8799-4041-4d22-a114-25af528ef0f1 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:09.382654 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cb0c8799-4041-4d22-a114-25af528ef0f1 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:09.383211 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cb0c8799-4041-4d22-a114-25af528ef0f1 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:09.384179 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cb0c8799-4041-4d22-a114-25af528ef0f1 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:09.384992 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-cb0c8799-4041-4d22-a114-25af528ef0f1 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:09.412579 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-cb0c8799-4041-4d22-a114-25af528ef0f1 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22/ips" status: 200 len: 146 microversion: 2.1 time: 0.044421 Aug 01 14:28:09.413627 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 494/976] 10.222.0.17 () {58 vars in 1248 bytes} [Mon Aug 1 14:28:09 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22/ips => generated 146 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:28:09.954088 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6bc4d50a-a554-40bb-92fa-f33d2c3e0188 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:09.956197 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-6bc4d50a-a554-40bb-92fa-f33d2c3e0188 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: fb882cc8-dad4-4898-9d57-ba546c8b1068] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:09.966170 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6bc4d50a-a554-40bb-92fa-f33d2c3e0188 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:09.967128 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6bc4d50a-a554-40bb-92fa-f33d2c3e0188 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:09.968644 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6bc4d50a-a554-40bb-92fa-f33d2c3e0188 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:09.970464 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6bc4d50a-a554-40bb-92fa-f33d2c3e0188 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:10.079300 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6bc4d50a-a554-40bb-92fa-f33d2c3e0188 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:10.093074 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6bc4d50a-a554-40bb-92fa-f33d2c3e0188 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068" status: 200 len: 1191 microversion: 2.1 time: 0.148951 Aug 01 14:28:10.104298 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 483/977] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:09 2022] GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068 => generated 1191 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:28:11.127218 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ff9fe975-5dbf-489f-9b9a-d576d7962c60 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:11.128984 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ff9fe975-5dbf-489f-9b9a-d576d7962c60 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: fb882cc8-dad4-4898-9d57-ba546c8b1068] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:11.135437 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ff9fe975-5dbf-489f-9b9a-d576d7962c60 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:11.135964 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ff9fe975-5dbf-489f-9b9a-d576d7962c60 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:11.144824 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ff9fe975-5dbf-489f-9b9a-d576d7962c60 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:11.145386 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ff9fe975-5dbf-489f-9b9a-d576d7962c60 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:11.326803 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ff9fe975-5dbf-489f-9b9a-d576d7962c60 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:11.348368 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ff9fe975-5dbf-489f-9b9a-d576d7962c60 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068" status: 200 len: 1197 microversion: 2.1 time: 0.225057 Aug 01 14:28:11.349606 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 495/978] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:11 2022] GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068 => generated 1197 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:12.266723 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8afeaba0-2d99-4997-aa47-4c17440508b1 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "710c06a4-4d54-446d-ac5c-99b256271c6c"}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:28:12.270475 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8afeaba0-2d99-4997-aa47-4c17440508b1 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:12.279323 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8afeaba0-2d99-4997-aa47-4c17440508b1 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:12.280021 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8afeaba0-2d99-4997-aa47-4c17440508b1 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:12.280906 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8afeaba0-2d99-4997-aa47-4c17440508b1 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:12.281408 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8afeaba0-2d99-4997-aa47-4c17440508b1 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:12.378555 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-00f134c9-2673-4e7b-b0c7-9c88cba9e2c2 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:12.379186 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-00f134c9-2673-4e7b-b0c7-9c88cba9e2c2 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: fb882cc8-dad4-4898-9d57-ba546c8b1068] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:12.396494 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-00f134c9-2673-4e7b-b0c7-9c88cba9e2c2 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:12.397262 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-00f134c9-2673-4e7b-b0c7-9c88cba9e2c2 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:12.398551 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-00f134c9-2673-4e7b-b0c7-9c88cba9e2c2 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:12.399166 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-00f134c9-2673-4e7b-b0c7-9c88cba9e2c2 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:12.695365 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8afeaba0-2d99-4997-aa47-4c17440508b1 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "POST /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.433187 Aug 01 14:28:12.702773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 484/979] 10.222.0.17 () {60 vars in 1323 bytes} [Mon Aug 1 14:28:12 2022] POST /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22/os-volume_attachments => generated 194 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:28:12.813767 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-00f134c9-2673-4e7b-b0c7-9c88cba9e2c2 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:12.827479 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-00f134c9-2673-4e7b-b0c7-9c88cba9e2c2 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068" status: 200 len: 1264 microversion: 2.1 time: 0.455831 Aug 01 14:28:12.828058 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 496/980] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:12 2022] GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068 => generated 1264 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:13.388870 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-568c8332-7ea7-4d0a-ac3e-0616b0d27e9a req-59c34863-7da6-4335-8b2d-edd260da7857 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb882cc8-dad4-4898-9d57-ba546c8b1068", "tag": "bd4c8486-8b99-459f-b0ee-44c166b81fff"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:28:13.403257 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-568c8332-7ea7-4d0a-ac3e-0616b0d27e9a req-59c34863-7da6-4335-8b2d-edd260da7857 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:13.403742 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-568c8332-7ea7-4d0a-ac3e-0616b0d27e9a req-59c34863-7da6-4335-8b2d-edd260da7857 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:13.416090 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-568c8332-7ea7-4d0a-ac3e-0616b0d27e9a req-59c34863-7da6-4335-8b2d-edd260da7857 service nova] Creating event network-changed:bd4c8486-8b99-459f-b0ee-44c166b81fff for instance fb882cc8-dad4-4898-9d57-ba546c8b1068 on hv-cinder-84599 Aug 01 14:28:13.421017 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-568c8332-7ea7-4d0a-ac3e-0616b0d27e9a req-59c34863-7da6-4335-8b2d-edd260da7857 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038576 Aug 01 14:28:13.421611 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 485/981] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:28:13.850946 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c3d88df0-8fc5-4647-b5e5-90a512bd37aa tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:13.851739 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c3d88df0-8fc5-4647-b5e5-90a512bd37aa tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: fb882cc8-dad4-4898-9d57-ba546c8b1068] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:13.858490 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c3d88df0-8fc5-4647-b5e5-90a512bd37aa tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:13.859566 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c3d88df0-8fc5-4647-b5e5-90a512bd37aa tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:13.859795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c3d88df0-8fc5-4647-b5e5-90a512bd37aa tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:13.860185 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c3d88df0-8fc5-4647-b5e5-90a512bd37aa tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:14.177404 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c3d88df0-8fc5-4647-b5e5-90a512bd37aa tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:14.190847 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c3d88df0-8fc5-4647-b5e5-90a512bd37aa tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068" status: 200 len: 1264 microversion: 2.1 time: 0.343612 Aug 01 14:28:14.192687 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 497/982] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:13 2022] GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068 => generated 1264 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:15.215603 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-57939feb-7ef4-46da-a14c-4810200447e8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:15.216316 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-57939feb-7ef4-46da-a14c-4810200447e8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: fb882cc8-dad4-4898-9d57-ba546c8b1068] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:15.224379 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-57939feb-7ef4-46da-a14c-4810200447e8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:15.224833 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-57939feb-7ef4-46da-a14c-4810200447e8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:15.225765 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-57939feb-7ef4-46da-a14c-4810200447e8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:15.226199 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-57939feb-7ef4-46da-a14c-4810200447e8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:15.777644 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-57939feb-7ef4-46da-a14c-4810200447e8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:15.788580 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-57939feb-7ef4-46da-a14c-4810200447e8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068" status: 200 len: 1264 microversion: 2.1 time: 0.577803 Aug 01 14:28:15.804291 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 486/983] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:15 2022] GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068 => generated 1264 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:16.811188 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-70077e59-74dc-4c2d-a5eb-f0ed1ca6d0fa tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:16.811998 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-70077e59-74dc-4c2d-a5eb-f0ed1ca6d0fa tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: fb882cc8-dad4-4898-9d57-ba546c8b1068] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:16.823999 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-70077e59-74dc-4c2d-a5eb-f0ed1ca6d0fa tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:16.824459 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-70077e59-74dc-4c2d-a5eb-f0ed1ca6d0fa tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:16.825263 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-70077e59-74dc-4c2d-a5eb-f0ed1ca6d0fa tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:16.825836 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-70077e59-74dc-4c2d-a5eb-f0ed1ca6d0fa tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:17.087618 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-70077e59-74dc-4c2d-a5eb-f0ed1ca6d0fa tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:17.103378 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-70077e59-74dc-4c2d-a5eb-f0ed1ca6d0fa tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068" status: 200 len: 1264 microversion: 2.1 time: 0.294545 Aug 01 14:28:17.119480 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 498/984] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:16 2022] GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068 => generated 1264 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:18.138837 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0ce593dd-2d9d-4c27-a14c-e64b065f8726 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:18.139426 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0ce593dd-2d9d-4c27-a14c-e64b065f8726 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: fb882cc8-dad4-4898-9d57-ba546c8b1068] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:18.150515 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0ce593dd-2d9d-4c27-a14c-e64b065f8726 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:18.150972 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0ce593dd-2d9d-4c27-a14c-e64b065f8726 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:18.151851 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0ce593dd-2d9d-4c27-a14c-e64b065f8726 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:18.152800 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0ce593dd-2d9d-4c27-a14c-e64b065f8726 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:18.464405 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0ce593dd-2d9d-4c27-a14c-e64b065f8726 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:18.477910 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0ce593dd-2d9d-4c27-a14c-e64b065f8726 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068" status: 200 len: 1264 microversion: 2.1 time: 0.343344 Aug 01 14:28:18.479085 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 487/985] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:18 2022] GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068 => generated 1264 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:19.501063 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6ea42412-05a5-4019-b17e-690e6f7a8ed7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:19.501942 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-6ea42412-05a5-4019-b17e-690e6f7a8ed7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: fb882cc8-dad4-4898-9d57-ba546c8b1068] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:19.508227 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=2 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:19.510963 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=6 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:19.517790 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6ea42412-05a5-4019-b17e-690e6f7a8ed7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:19.518537 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6ea42412-05a5-4019-b17e-690e6f7a8ed7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:19.519595 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6ea42412-05a5-4019-b17e-690e6f7a8ed7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:19.520190 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6ea42412-05a5-4019-b17e-690e6f7a8ed7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:19.737921 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6ea42412-05a5-4019-b17e-690e6f7a8ed7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:19.747734 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6ea42412-05a5-4019-b17e-690e6f7a8ed7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068" status: 200 len: 1264 microversion: 2.1 time: 0.250326 Aug 01 14:28:19.760761 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 499/986] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:19 2022] GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068 => generated 1264 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:20.519707 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c7759ef7-f29a-4ec0-9c42-8a043d942cad tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:28:20.527214 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:20.532911 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c7759ef7-f29a-4ec0-9c42-8a043d942cad tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:20.533675 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c7759ef7-f29a-4ec0-9c42-8a043d942cad tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:20.616666 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c7759ef7-f29a-4ec0-9c42-8a043d942cad tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Going to try to stop instance {{(pid=118133) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 01 14:28:20.674697 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c7759ef7-f29a-4ec0-9c42-8a043d942cad tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "POST /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22/action" status: 202 len: 0 microversion: 2.1 time: 0.159266 Aug 01 14:28:20.675645 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 488/987] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Aug 1 14:28:20 2022] POST /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 14:28:20.687646 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c4e9be6a-d3fe-4d70-9c23-b7f75a742a18 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:20.689107 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c4e9be6a-d3fe-4d70-9c23-b7f75a742a18 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:20.701006 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c4e9be6a-d3fe-4d70-9c23-b7f75a742a18 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:20.701888 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c4e9be6a-d3fe-4d70-9c23-b7f75a742a18 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:20.702908 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c4e9be6a-d3fe-4d70-9c23-b7f75a742a18 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:20.703488 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c4e9be6a-d3fe-4d70-9c23-b7f75a742a18 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:20.770775 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ddd794db-eee0-45d8-82f0-712c439621e3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:20.772301 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ddd794db-eee0-45d8-82f0-712c439621e3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: fb882cc8-dad4-4898-9d57-ba546c8b1068] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:20.778923 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ddd794db-eee0-45d8-82f0-712c439621e3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:20.779378 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ddd794db-eee0-45d8-82f0-712c439621e3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:20.780206 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ddd794db-eee0-45d8-82f0-712c439621e3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:20.780647 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ddd794db-eee0-45d8-82f0-712c439621e3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:20.934818 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c4e9be6a-d3fe-4d70-9c23-b7f75a742a18 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:20.944147 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c4e9be6a-d3fe-4d70-9c23-b7f75a742a18 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1724 microversion: 2.1 time: 0.263134 Aug 01 14:28:20.947939 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 500/988] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:20 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:20.959890 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ddd794db-eee0-45d8-82f0-712c439621e3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:20.968251 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ddd794db-eee0-45d8-82f0-712c439621e3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068" status: 200 len: 1264 microversion: 2.1 time: 0.201713 Aug 01 14:28:20.968866 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 489/989] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:20 2022] GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068 => generated 1264 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:28:21.973330 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c6e95c74-8878-4c00-b31f-c492795b28eb tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:21.974696 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c6e95c74-8878-4c00-b31f-c492795b28eb tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:21.982820 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c6e95c74-8878-4c00-b31f-c492795b28eb tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:21.987878 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c6e95c74-8878-4c00-b31f-c492795b28eb tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:21.991718 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c6e95c74-8878-4c00-b31f-c492795b28eb tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:21.992311 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c6e95c74-8878-4c00-b31f-c492795b28eb tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:21.992999 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0a7de4cd-bebe-4cc5-89c4-5f3b31baa6dd tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:21.994110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0a7de4cd-bebe-4cc5-89c4-5f3b31baa6dd tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: fb882cc8-dad4-4898-9d57-ba546c8b1068] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:22.002300 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0a7de4cd-bebe-4cc5-89c4-5f3b31baa6dd tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:22.002746 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0a7de4cd-bebe-4cc5-89c4-5f3b31baa6dd tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:22.003534 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0a7de4cd-bebe-4cc5-89c4-5f3b31baa6dd tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:22.004128 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0a7de4cd-bebe-4cc5-89c4-5f3b31baa6dd tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:22.173697 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0a7de4cd-bebe-4cc5-89c4-5f3b31baa6dd tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:22.183228 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0a7de4cd-bebe-4cc5-89c4-5f3b31baa6dd tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068" status: 200 len: 1264 microversion: 2.1 time: 0.193890 Aug 01 14:28:22.188054 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 490/990] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:21 2022] GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068 => generated 1264 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:22.206395 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c6e95c74-8878-4c00-b31f-c492795b28eb tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:22.214911 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c6e95c74-8878-4c00-b31f-c492795b28eb tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1724 microversion: 2.1 time: 0.246435 Aug 01 14:28:22.215503 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 501/991] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:21 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:22.494043 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3ea44704-b2af-4ea4-a40e-3fefdc4f6018 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Action: 'create', calling method: .version_select at 0x7f6185553c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1940015835", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNm0wEFggIuB4ta22z4q2c4T1i1L1Z8BrCTeeAFXkF7hy3F+11uvxKlO9cOd235a94QqBDHEipRivAeoKg3x1omQyOZfzIjylX7e3/e97pgO64ZQnuSQcX2SyQhpJyACHQ=="}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:28:22.510388 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-3ea44704-b2af-4ea4-a40e-3fefdc4f6018 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Getting quotas for project 2a6eb59bc9a445cc9f5b4d3059fbb7f1. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:28:22.514354 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-3ea44704-b2af-4ea4-a40e-3fefdc4f6018 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Getting quotas for user 6040773eefe146a0adbc7858c7371cb8 and project 2a6eb59bc9a445cc9f5b4d3059fbb7f1. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:28:22.538022 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3ea44704-b2af-4ea4-a40e-3fefdc4f6018 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.348542 Aug 01 14:28:22.538654 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 491/992] 10.222.0.17 () {60 vars in 1159 bytes} [Mon Aug 1 14:28:22 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:28:23.210740 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2a83dec1-4103-4b25-8e1b-0d9cedc78f39 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:23.211931 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2a83dec1-4103-4b25-8e1b-0d9cedc78f39 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: fb882cc8-dad4-4898-9d57-ba546c8b1068] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:23.228398 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2a83dec1-4103-4b25-8e1b-0d9cedc78f39 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:23.230085 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2a83dec1-4103-4b25-8e1b-0d9cedc78f39 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:23.231895 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2a83dec1-4103-4b25-8e1b-0d9cedc78f39 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:23.232923 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2a83dec1-4103-4b25-8e1b-0d9cedc78f39 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:23.239436 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ffc0fe7f-1331-479e-9041-0bd5a0a05b7c tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:23.240400 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ffc0fe7f-1331-479e-9041-0bd5a0a05b7c tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:23.253863 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ffc0fe7f-1331-479e-9041-0bd5a0a05b7c tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:23.259980 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ffc0fe7f-1331-479e-9041-0bd5a0a05b7c tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:23.260938 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ffc0fe7f-1331-479e-9041-0bd5a0a05b7c tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:23.261443 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ffc0fe7f-1331-479e-9041-0bd5a0a05b7c tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:23.467960 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-2a83dec1-4103-4b25-8e1b-0d9cedc78f39 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:23.477454 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2a83dec1-4103-4b25-8e1b-0d9cedc78f39 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068" status: 200 len: 1264 microversion: 2.1 time: 0.272533 Aug 01 14:28:23.492082 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 502/993] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:23 2022] GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068 => generated 1264 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:23.495413 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ffc0fe7f-1331-479e-9041-0bd5a0a05b7c tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:23.506222 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ffc0fe7f-1331-479e-9041-0bd5a0a05b7c tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1724 microversion: 2.1 time: 0.272793 Aug 01 14:28:23.507082 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 492/994] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:23 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:28:24.234773 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-e0a686c2-bfd5-4b5d-be60-6b70e7b94ffe req-6f0b9e7a-eb25-428f-a7a9-a78e853a0442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb882cc8-dad4-4898-9d57-ba546c8b1068", "name": "network-vif-plugged", "status": "completed", "tag": "bd4c8486-8b99-459f-b0ee-44c166b81fff"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:28:24.245163 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-e0a686c2-bfd5-4b5d-be60-6b70e7b94ffe req-6f0b9e7a-eb25-428f-a7a9-a78e853a0442 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:24.246127 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-e0a686c2-bfd5-4b5d-be60-6b70e7b94ffe req-6f0b9e7a-eb25-428f-a7a9-a78e853a0442 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:24.260470 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-e0a686c2-bfd5-4b5d-be60-6b70e7b94ffe req-6f0b9e7a-eb25-428f-a7a9-a78e853a0442 service nova] Creating event network-vif-plugged:bd4c8486-8b99-459f-b0ee-44c166b81fff for instance fb882cc8-dad4-4898-9d57-ba546c8b1068 on hv-cinder-84599 Aug 01 14:28:24.268648 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-e0a686c2-bfd5-4b5d-be60-6b70e7b94ffe req-6f0b9e7a-eb25-428f-a7a9-a78e853a0442 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037547 Aug 01 14:28:24.270432 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 503/995] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:28:24.512128 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-535735cc-32ba-4fff-9191-19714a1e09c7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:24.512942 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-535735cc-32ba-4fff-9191-19714a1e09c7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: fb882cc8-dad4-4898-9d57-ba546c8b1068] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:24.520722 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-535735cc-32ba-4fff-9191-19714a1e09c7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:24.521343 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-535735cc-32ba-4fff-9191-19714a1e09c7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:24.522400 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-535735cc-32ba-4fff-9191-19714a1e09c7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:24.523107 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-535735cc-32ba-4fff-9191-19714a1e09c7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:24.531098 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c09463c4-113a-4bd0-ab40-9316654ad6c8 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:24.532260 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c09463c4-113a-4bd0-ab40-9316654ad6c8 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:24.554491 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c09463c4-113a-4bd0-ab40-9316654ad6c8 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:24.555395 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c09463c4-113a-4bd0-ab40-9316654ad6c8 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:24.557670 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c09463c4-113a-4bd0-ab40-9316654ad6c8 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:24.559014 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c09463c4-113a-4bd0-ab40-9316654ad6c8 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:24.703144 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-535735cc-32ba-4fff-9191-19714a1e09c7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:24.711989 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-535735cc-32ba-4fff-9191-19714a1e09c7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068" status: 200 len: 1264 microversion: 2.1 time: 0.204004 Aug 01 14:28:24.712761 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 493/996] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:24 2022] GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068 => generated 1264 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:24.774546 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c09463c4-113a-4bd0-ab40-9316654ad6c8 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:24.784759 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c09463c4-113a-4bd0-ab40-9316654ad6c8 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1724 microversion: 2.1 time: 0.259179 Aug 01 14:28:24.785056 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 504/997] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:24 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:25.733147 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e2af2f1a-f523-424d-b367-b9d243b58adf tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:25.733850 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e2af2f1a-f523-424d-b367-b9d243b58adf tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: fb882cc8-dad4-4898-9d57-ba546c8b1068] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:25.742512 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e2af2f1a-f523-424d-b367-b9d243b58adf tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:25.742975 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e2af2f1a-f523-424d-b367-b9d243b58adf tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:25.743788 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e2af2f1a-f523-424d-b367-b9d243b58adf tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:25.744221 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e2af2f1a-f523-424d-b367-b9d243b58adf tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:25.811955 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-48468d80-ca45-4dc2-bdb1-ba881dc78cbd tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:25.813698 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-48468d80-ca45-4dc2-bdb1-ba881dc78cbd tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:25.825663 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-48468d80-ca45-4dc2-bdb1-ba881dc78cbd tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:25.827097 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-48468d80-ca45-4dc2-bdb1-ba881dc78cbd tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:25.829456 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-48468d80-ca45-4dc2-bdb1-ba881dc78cbd tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:25.830447 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-48468d80-ca45-4dc2-bdb1-ba881dc78cbd tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:25.923250 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e2af2f1a-f523-424d-b367-b9d243b58adf tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:25.930675 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e2af2f1a-f523-424d-b367-b9d243b58adf tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068" status: 200 len: 1264 microversion: 2.1 time: 0.202033 Aug 01 14:28:25.931721 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 494/998] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:25 2022] GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068 => generated 1264 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:26.042402 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-48468d80-ca45-4dc2-bdb1-ba881dc78cbd tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:26.052850 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-48468d80-ca45-4dc2-bdb1-ba881dc78cbd tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1724 microversion: 2.1 time: 0.249073 Aug 01 14:28:26.054005 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 505/999] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:25 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:26.952347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-833b452c-c047-4c3c-beb6-945b461d2798 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:26.952965 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-833b452c-c047-4c3c-beb6-945b461d2798 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: fb882cc8-dad4-4898-9d57-ba546c8b1068] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:26.961055 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-833b452c-c047-4c3c-beb6-945b461d2798 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:26.961480 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-833b452c-c047-4c3c-beb6-945b461d2798 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:26.962304 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-833b452c-c047-4c3c-beb6-945b461d2798 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:26.962741 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-833b452c-c047-4c3c-beb6-945b461d2798 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:27.075533 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-19c1e4b7-f7ca-4070-8904-fcf791b00f95 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:27.076203 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-19c1e4b7-f7ca-4070-8904-fcf791b00f95 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:27.082563 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-19c1e4b7-f7ca-4070-8904-fcf791b00f95 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:27.082999 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-19c1e4b7-f7ca-4070-8904-fcf791b00f95 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:27.083804 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-19c1e4b7-f7ca-4070-8904-fcf791b00f95 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:27.084274 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-19c1e4b7-f7ca-4070-8904-fcf791b00f95 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:27.127324 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-833b452c-c047-4c3c-beb6-945b461d2798 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:27.135205 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-833b452c-c047-4c3c-beb6-945b461d2798 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068" status: 200 len: 1450 microversion: 2.1 time: 0.186771 Aug 01 14:28:27.136037 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 495/1000] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:26 2022] GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068 => generated 1450 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:27.156250 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-77f3cbc6-dd08-4770-8b32-8578fe6f5039 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:27.157195 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-77f3cbc6-dd08-4770-8b32-8578fe6f5039 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: fb882cc8-dad4-4898-9d57-ba546c8b1068] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:27.164937 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-77f3cbc6-dd08-4770-8b32-8578fe6f5039 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:27.165537 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-77f3cbc6-dd08-4770-8b32-8578fe6f5039 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:27.166552 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-77f3cbc6-dd08-4770-8b32-8578fe6f5039 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:27.167211 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-77f3cbc6-dd08-4770-8b32-8578fe6f5039 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:27.238178 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-19c1e4b7-f7ca-4070-8904-fcf791b00f95 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:27.250280 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-19c1e4b7-f7ca-4070-8904-fcf791b00f95 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1724 microversion: 2.1 time: 0.179860 Aug 01 14:28:27.250871 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 506/1001] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:27 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:28:27.315974 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-77f3cbc6-dd08-4770-8b32-8578fe6f5039 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:27.324404 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-77f3cbc6-dd08-4770-8b32-8578fe6f5039 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068" status: 200 len: 1450 microversion: 2.1 time: 0.172009 Aug 01 14:28:27.324955 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 496/1002] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:27 2022] GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068 => generated 1450 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:28.271063 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-86531b83-fcb1-4087-b27c-ecc87b154d03 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:28.271954 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-86531b83-fcb1-4087-b27c-ecc87b154d03 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:28.278719 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-86531b83-fcb1-4087-b27c-ecc87b154d03 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:28.279442 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-86531b83-fcb1-4087-b27c-ecc87b154d03 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:28.280449 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-86531b83-fcb1-4087-b27c-ecc87b154d03 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:28.281700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-86531b83-fcb1-4087-b27c-ecc87b154d03 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:28.426049 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-86531b83-fcb1-4087-b27c-ecc87b154d03 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:28.435433 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-86531b83-fcb1-4087-b27c-ecc87b154d03 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1724 microversion: 2.1 time: 0.168293 Aug 01 14:28:28.436037 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 507/1003] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:28 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:29.456600 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-700b7070-12ef-42b5-96cf-60a7b683f18a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:29.457194 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-700b7070-12ef-42b5-96cf-60a7b683f18a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:29.468561 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-700b7070-12ef-42b5-96cf-60a7b683f18a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:29.469232 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-700b7070-12ef-42b5-96cf-60a7b683f18a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:29.470532 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-700b7070-12ef-42b5-96cf-60a7b683f18a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:29.470979 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-700b7070-12ef-42b5-96cf-60a7b683f18a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:29.749670 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-700b7070-12ef-42b5-96cf-60a7b683f18a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:29.757822 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-700b7070-12ef-42b5-96cf-60a7b683f18a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1724 microversion: 2.1 time: 0.305048 Aug 01 14:28:29.758398 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 497/1004] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:29 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1724 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:29.972502 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-3a72a063-5f09-4596-a9a4-cbdd45c9ef7a req-c4c61106-50e6-4846-9c6c-7988786a1609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb882cc8-dad4-4898-9d57-ba546c8b1068", "tag": "bd4c8486-8b99-459f-b0ee-44c166b81fff"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:28:29.983832 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-3a72a063-5f09-4596-a9a4-cbdd45c9ef7a req-c4c61106-50e6-4846-9c6c-7988786a1609 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:29.984353 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-3a72a063-5f09-4596-a9a4-cbdd45c9ef7a req-c4c61106-50e6-4846-9c6c-7988786a1609 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:29.998101 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-3a72a063-5f09-4596-a9a4-cbdd45c9ef7a req-c4c61106-50e6-4846-9c6c-7988786a1609 service nova] Creating event network-changed:bd4c8486-8b99-459f-b0ee-44c166b81fff for instance fb882cc8-dad4-4898-9d57-ba546c8b1068 on hv-cinder-84599 Aug 01 14:28:30.003598 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-3a72a063-5f09-4596-a9a4-cbdd45c9ef7a req-c4c61106-50e6-4846-9c6c-7988786a1609 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034714 Aug 01 14:28:30.004438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 508/1005] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:28:30.778705 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-fc0beae6-4fff-41e2-8b3d-838776846779 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:30.780107 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-fc0beae6-4fff-41e2-8b3d-838776846779 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:30.787151 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fc0beae6-4fff-41e2-8b3d-838776846779 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:30.787724 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fc0beae6-4fff-41e2-8b3d-838776846779 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:30.788746 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fc0beae6-4fff-41e2-8b3d-838776846779 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:30.789390 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fc0beae6-4fff-41e2-8b3d-838776846779 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:30.971347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-fc0beae6-4fff-41e2-8b3d-838776846779 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:30.976204 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:30.986798 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-fc0beae6-4fff-41e2-8b3d-838776846779 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1724 microversion: 2.1 time: 0.212253 Aug 01 14:28:30.987673 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 498/1006] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:30 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:32.015033 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b8dfa0e2-aaf9-47aa-b4ff-7fb046140744 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:32.015795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b8dfa0e2-aaf9-47aa-b4ff-7fb046140744 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:32.022203 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b8dfa0e2-aaf9-47aa-b4ff-7fb046140744 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:32.022646 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b8dfa0e2-aaf9-47aa-b4ff-7fb046140744 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:32.023410 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b8dfa0e2-aaf9-47aa-b4ff-7fb046140744 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:32.023867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b8dfa0e2-aaf9-47aa-b4ff-7fb046140744 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:32.169332 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b8dfa0e2-aaf9-47aa-b4ff-7fb046140744 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:32.179084 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b8dfa0e2-aaf9-47aa-b4ff-7fb046140744 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1724 microversion: 2.1 time: 0.168900 Aug 01 14:28:32.179709 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 509/1007] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:32 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:33.203969 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f8c55c8d-42ef-4e2f-a895-f2ee836b7346 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:33.204625 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f8c55c8d-42ef-4e2f-a895-f2ee836b7346 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:33.207297 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=4 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:33.213774 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f8c55c8d-42ef-4e2f-a895-f2ee836b7346 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:33.214224 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f8c55c8d-42ef-4e2f-a895-f2ee836b7346 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:33.215548 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f8c55c8d-42ef-4e2f-a895-f2ee836b7346 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:33.215999 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f8c55c8d-42ef-4e2f-a895-f2ee836b7346 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:33.350064 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f8c55c8d-42ef-4e2f-a895-f2ee836b7346 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:33.358128 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f8c55c8d-42ef-4e2f-a895-f2ee836b7346 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1724 microversion: 2.1 time: 0.158270 Aug 01 14:28:33.358693 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 499/1008] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:33 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:34.379049 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7567942f-314f-46cb-8c55-8c9a04f418ba tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:34.379720 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7567942f-314f-46cb-8c55-8c9a04f418ba tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:34.386428 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7567942f-314f-46cb-8c55-8c9a04f418ba tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:34.386873 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7567942f-314f-46cb-8c55-8c9a04f418ba tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:34.387675 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7567942f-314f-46cb-8c55-8c9a04f418ba tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:34.388104 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7567942f-314f-46cb-8c55-8c9a04f418ba tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:34.518314 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7567942f-314f-46cb-8c55-8c9a04f418ba tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:34.526172 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7567942f-314f-46cb-8c55-8c9a04f418ba tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1724 microversion: 2.1 time: 0.151805 Aug 01 14:28:34.526729 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 510/1009] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:34 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:35.548737 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-09210882-a0a1-4ee7-9139-d9d2145d3bc0 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:35.549383 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-09210882-a0a1-4ee7-9139-d9d2145d3bc0 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:35.555938 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-09210882-a0a1-4ee7-9139-d9d2145d3bc0 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:35.556390 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-09210882-a0a1-4ee7-9139-d9d2145d3bc0 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:35.557178 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-09210882-a0a1-4ee7-9139-d9d2145d3bc0 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:35.557613 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-09210882-a0a1-4ee7-9139-d9d2145d3bc0 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:35.697666 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-09210882-a0a1-4ee7-9139-d9d2145d3bc0 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:35.707278 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-09210882-a0a1-4ee7-9139-d9d2145d3bc0 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1724 microversion: 2.1 time: 0.162430 Aug 01 14:28:35.707891 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 500/1010] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:35 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:36.729951 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ab5ec68e-0979-4b0f-8f86-6bc4ef6cc6f9 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:36.731225 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ab5ec68e-0979-4b0f-8f86-6bc4ef6cc6f9 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:36.737645 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ab5ec68e-0979-4b0f-8f86-6bc4ef6cc6f9 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:36.738093 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ab5ec68e-0979-4b0f-8f86-6bc4ef6cc6f9 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:36.738853 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ab5ec68e-0979-4b0f-8f86-6bc4ef6cc6f9 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:36.739287 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ab5ec68e-0979-4b0f-8f86-6bc4ef6cc6f9 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:36.870985 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ab5ec68e-0979-4b0f-8f86-6bc4ef6cc6f9 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:36.874583 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=100 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:36.879953 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ab5ec68e-0979-4b0f-8f86-6bc4ef6cc6f9 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1724 microversion: 2.1 time: 0.153850 Aug 01 14:28:36.880535 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 511/1011] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:36 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:37.901306 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-fad608a2-3210-46b9-9a4b-4e9e7ad9cd88 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:37.901906 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-fad608a2-3210-46b9-9a4b-4e9e7ad9cd88 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:37.908518 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fad608a2-3210-46b9-9a4b-4e9e7ad9cd88 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:37.908964 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fad608a2-3210-46b9-9a4b-4e9e7ad9cd88 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:37.909749 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fad608a2-3210-46b9-9a4b-4e9e7ad9cd88 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:37.910171 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fad608a2-3210-46b9-9a4b-4e9e7ad9cd88 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:38.045170 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-fad608a2-3210-46b9-9a4b-4e9e7ad9cd88 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:38.053710 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-fad608a2-3210-46b9-9a4b-4e9e7ad9cd88 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1724 microversion: 2.1 time: 0.156265 Aug 01 14:28:38.054299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 501/1012] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:37 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:39.076384 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-071f8638-a921-4aff-b69f-82f681176583 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:39.077024 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-071f8638-a921-4aff-b69f-82f681176583 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:39.079373 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:39.084989 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-071f8638-a921-4aff-b69f-82f681176583 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:39.085439 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-071f8638-a921-4aff-b69f-82f681176583 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:39.086215 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-071f8638-a921-4aff-b69f-82f681176583 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:39.086686 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-071f8638-a921-4aff-b69f-82f681176583 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:39.150470 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-53b7224f-b9f4-4ff7-9cca-bc627154d57e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-867705850", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1940015835", "security_groups": [{"name": "tempest-secgroup-smoke-1503778676"}], "networks": [{"uuid": "0aada5ce-a480-42d3-b544-7ccc0036a637"}], "block_device_mapping_v2": [{"uuid": "621176ff-2949-4797-859f-2967d9a6c30f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:28:39.161395 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:39.234127 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-071f8638-a921-4aff-b69f-82f681176583 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:39.242951 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-071f8638-a921-4aff-b69f-82f681176583 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1724 microversion: 2.1 time: 0.171210 Aug 01 14:28:39.243594 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 512/1013] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:39 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:39.280708 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.network.neutron [None req-53b7224f-b9f4-4ff7-9cca-bc627154d57e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] validate_networks() for [('0aada5ce-a480-42d3-b544-7ccc0036a637', None, None, None, None, None)] {{(pid=118133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:28:39.847807 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-53b7224f-b9f4-4ff7-9cca-bc627154d57e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Flavor limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:28:39.848235 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-53b7224f-b9f4-4ff7-9cca-bc627154d57e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Image limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:28:39.848707 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-53b7224f-b9f4-4ff7-9cca-bc627154d57e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Flavor pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:28:39.849112 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-53b7224f-b9f4-4ff7-9cca-bc627154d57e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Image pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:28:39.849525 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-53b7224f-b9f4-4ff7-9cca-bc627154d57e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:28:39.858974 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-53b7224f-b9f4-4ff7-9cca-bc627154d57e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:39.859423 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-53b7224f-b9f4-4ff7-9cca-bc627154d57e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:39.860273 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-53b7224f-b9f4-4ff7-9cca-bc627154d57e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:39.860708 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-53b7224f-b9f4-4ff7-9cca-bc627154d57e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:39.877022 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-53b7224f-b9f4-4ff7-9cca-bc627154d57e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Getting quotas for project 2a6eb59bc9a445cc9f5b4d3059fbb7f1. Resources: {'instances', 'cores', 'ram'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:28:39.881133 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-53b7224f-b9f4-4ff7-9cca-bc627154d57e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Getting quotas for user 6040773eefe146a0adbc7858c7371cb8 and project 2a6eb59bc9a445cc9f5b4d3059fbb7f1. Resources: {'instances', 'cores', 'ram'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:28:39.938172 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-53b7224f-b9f4-4ff7-9cca-bc627154d57e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Going to run 1 instances... {{(pid=118133) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:28:39.940293 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-53b7224f-b9f4-4ff7-9cca-bc627154d57e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='621176ff-2949-4797-859f-2967d9a6c30f',volume_size=None,volume_type=None)] {{(pid=118133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:28:40.072885 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-53b7224f-b9f4-4ff7-9cca-bc627154d57e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.926712 Aug 01 14:28:40.073510 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 502/1014] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Aug 1 14:28:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 14:28:40.084006 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-890e50c1-5c40-4a1e-ab5c-94b889fb9fc5 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:40.084613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-890e50c1-5c40-4a1e-ab5c-94b889fb9fc5 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:40.141964 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-890e50c1-5c40-4a1e-ab5c-94b889fb9fc5 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:40.148845 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-890e50c1-5c40-4a1e-ab5c-94b889fb9fc5 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1088 microversion: 2.1 time: 0.068504 Aug 01 14:28:40.149410 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 513/1015] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:40 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:40.267495 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b81027e4-c5e4-45fe-9786-51c3427af9d6 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:40.268101 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b81027e4-c5e4-45fe-9786-51c3427af9d6 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:40.275252 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b81027e4-c5e4-45fe-9786-51c3427af9d6 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:40.275743 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b81027e4-c5e4-45fe-9786-51c3427af9d6 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:40.276527 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b81027e4-c5e4-45fe-9786-51c3427af9d6 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:40.276970 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b81027e4-c5e4-45fe-9786-51c3427af9d6 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:40.428562 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b81027e4-c5e4-45fe-9786-51c3427af9d6 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:40.437491 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b81027e4-c5e4-45fe-9786-51c3427af9d6 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1724 microversion: 2.1 time: 0.175658 Aug 01 14:28:40.438068 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 503/1016] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:40 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:41.169587 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-98a608a2-f8c3-488b-a140-a12b1fdb0bdf tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:41.170205 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-98a608a2-f8c3-488b-a140-a12b1fdb0bdf tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:41.178524 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-98a608a2-f8c3-488b-a140-a12b1fdb0bdf tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:41.178968 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-98a608a2-f8c3-488b-a140-a12b1fdb0bdf tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:41.179899 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-98a608a2-f8c3-488b-a140-a12b1fdb0bdf tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:41.180329 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-98a608a2-f8c3-488b-a140-a12b1fdb0bdf tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:41.244110 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-98a608a2-f8c3-488b-a140-a12b1fdb0bdf tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:41.251906 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-98a608a2-f8c3-488b-a140-a12b1fdb0bdf tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1186 microversion: 2.1 time: 0.086621 Aug 01 14:28:41.252655 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 514/1017] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:41 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:41.460087 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-2b778e73-04e4-42d1-94b4-7db895179505 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:41.460733 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-2b778e73-04e4-42d1-94b4-7db895179505 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:41.468219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2b778e73-04e4-42d1-94b4-7db895179505 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:41.468667 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2b778e73-04e4-42d1-94b4-7db895179505 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:41.469498 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2b778e73-04e4-42d1-94b4-7db895179505 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:41.470060 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2b778e73-04e4-42d1-94b4-7db895179505 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:41.617692 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2b778e73-04e4-42d1-94b4-7db895179505 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:41.627367 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-2b778e73-04e4-42d1-94b4-7db895179505 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1724 microversion: 2.1 time: 0.171000 Aug 01 14:28:41.627988 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 504/1018] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:41 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:42.275484 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5c3c62c6-9d49-4ac5-865f-92457e66b450 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:42.276725 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5c3c62c6-9d49-4ac5-865f-92457e66b450 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:42.283385 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5c3c62c6-9d49-4ac5-865f-92457e66b450 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:42.284202 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5c3c62c6-9d49-4ac5-865f-92457e66b450 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:42.285375 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5c3c62c6-9d49-4ac5-865f-92457e66b450 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:42.286038 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5c3c62c6-9d49-4ac5-865f-92457e66b450 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:42.531052 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-5c3c62c6-9d49-4ac5-865f-92457e66b450 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:42.539503 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5c3c62c6-9d49-4ac5-865f-92457e66b450 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1272 microversion: 2.1 time: 0.268857 Aug 01 14:28:42.540087 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 515/1019] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:42 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1272 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:42.651745 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-eeecb51a-df11-4530-99a1-030af1f7f6be tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:42.652595 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-eeecb51a-df11-4530-99a1-030af1f7f6be tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:42.664288 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-eeecb51a-df11-4530-99a1-030af1f7f6be tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:42.665148 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-eeecb51a-df11-4530-99a1-030af1f7f6be tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:42.665843 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-eeecb51a-df11-4530-99a1-030af1f7f6be tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:42.666282 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-eeecb51a-df11-4530-99a1-030af1f7f6be tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:42.801046 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-eeecb51a-df11-4530-99a1-030af1f7f6be tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:42.809350 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-eeecb51a-df11-4530-99a1-030af1f7f6be tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1701 microversion: 2.1 time: 0.161916 Aug 01 14:28:42.809918 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 505/1020] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:42 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1701 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:42.829920 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9cbdc74c-d441-4a24-a868-3e24a5883fba tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:28:42.836190 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9cbdc74c-d441-4a24-a868-3e24a5883fba tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:42.836640 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9cbdc74c-d441-4a24-a868-3e24a5883fba tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:42.897240 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9cbdc74c-d441-4a24-a868-3e24a5883fba tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Going to try to start instance {{(pid=118132) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 01 14:28:42.942113 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9cbdc74c-d441-4a24-a868-3e24a5883fba tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "POST /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22/action" status: 202 len: 0 microversion: 2.1 time: 0.115720 Aug 01 14:28:42.945850 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 516/1021] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Aug 1 14:28:42 2022] POST /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:28:42.952475 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-47579b86-54ee-43ab-a454-73eacc4ab826 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:42.953303 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-47579b86-54ee-43ab-a454-73eacc4ab826 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:42.959749 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-47579b86-54ee-43ab-a454-73eacc4ab826 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:42.960199 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-47579b86-54ee-43ab-a454-73eacc4ab826 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:42.961149 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-47579b86-54ee-43ab-a454-73eacc4ab826 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:42.961775 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-47579b86-54ee-43ab-a454-73eacc4ab826 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:43.104437 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-47579b86-54ee-43ab-a454-73eacc4ab826 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:43.113246 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-47579b86-54ee-43ab-a454-73eacc4ab826 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1710 microversion: 2.1 time: 0.165465 Aug 01 14:28:43.113887 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 506/1022] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:42 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1710 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:43.248516 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-564151d8-5ba0-4fa4-86f3-1b3862ce0106 req-546f4c7c-3514-4c39-b040-105cfc28340f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e51815a-0d9e-494f-8960-a75433080b70", "tag": "4bdcf192-f56a-4ae6-a4bb-17090119b4d9"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:28:43.260519 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-564151d8-5ba0-4fa4-86f3-1b3862ce0106 req-546f4c7c-3514-4c39-b040-105cfc28340f service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:43.261563 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-564151d8-5ba0-4fa4-86f3-1b3862ce0106 req-546f4c7c-3514-4c39-b040-105cfc28340f service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:43.275368 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-564151d8-5ba0-4fa4-86f3-1b3862ce0106 req-546f4c7c-3514-4c39-b040-105cfc28340f service nova] Creating event network-changed:4bdcf192-f56a-4ae6-a4bb-17090119b4d9 for instance 3e51815a-0d9e-494f-8960-a75433080b70 on hv-cinder-84599 Aug 01 14:28:43.281359 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-564151d8-5ba0-4fa4-86f3-1b3862ce0106 req-546f4c7c-3514-4c39-b040-105cfc28340f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036706 Aug 01 14:28:43.282017 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 517/1023] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:28:43.561962 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f5740408-d46c-4b25-a64a-dd401342ab7d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:43.562716 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f5740408-d46c-4b25-a64a-dd401342ab7d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:43.569176 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f5740408-d46c-4b25-a64a-dd401342ab7d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:43.569622 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f5740408-d46c-4b25-a64a-dd401342ab7d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:43.570394 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f5740408-d46c-4b25-a64a-dd401342ab7d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:43.571018 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f5740408-d46c-4b25-a64a-dd401342ab7d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:43.713693 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f5740408-d46c-4b25-a64a-dd401342ab7d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:43.722183 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f5740408-d46c-4b25-a64a-dd401342ab7d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1260 microversion: 2.1 time: 0.164778 Aug 01 14:28:43.722961 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 507/1024] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:43 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:44.136111 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-546d593a-7d7e-4d81-a427-69bc3941425a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:44.136989 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-546d593a-7d7e-4d81-a427-69bc3941425a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:44.144316 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-546d593a-7d7e-4d81-a427-69bc3941425a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:44.144764 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-546d593a-7d7e-4d81-a427-69bc3941425a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:44.145539 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-546d593a-7d7e-4d81-a427-69bc3941425a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:44.145970 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-546d593a-7d7e-4d81-a427-69bc3941425a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:44.338789 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-546d593a-7d7e-4d81-a427-69bc3941425a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:44.349209 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-546d593a-7d7e-4d81-a427-69bc3941425a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1710 microversion: 2.1 time: 0.217893 Aug 01 14:28:44.349788 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 518/1025] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:44 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1710 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:44.743566 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-4fe801bc-e532-44dc-966a-cda8bc7eed65 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:44.744184 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-4fe801bc-e532-44dc-966a-cda8bc7eed65 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:44.751519 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4fe801bc-e532-44dc-966a-cda8bc7eed65 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:44.751519 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4fe801bc-e532-44dc-966a-cda8bc7eed65 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:44.752492 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4fe801bc-e532-44dc-966a-cda8bc7eed65 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:44.752492 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4fe801bc-e532-44dc-966a-cda8bc7eed65 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:44.891899 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4fe801bc-e532-44dc-966a-cda8bc7eed65 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:44.899893 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-4fe801bc-e532-44dc-966a-cda8bc7eed65 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1260 microversion: 2.1 time: 0.160107 Aug 01 14:28:44.900472 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 508/1026] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:44 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:45.373173 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c5add5af-860d-412c-bbfe-a2a69d042766 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:45.373798 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c5add5af-860d-412c-bbfe-a2a69d042766 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:45.380377 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c5add5af-860d-412c-bbfe-a2a69d042766 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:45.380816 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c5add5af-860d-412c-bbfe-a2a69d042766 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:45.381578 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c5add5af-860d-412c-bbfe-a2a69d042766 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:45.382005 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c5add5af-860d-412c-bbfe-a2a69d042766 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:45.577920 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c5add5af-860d-412c-bbfe-a2a69d042766 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:45.585976 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c5add5af-860d-412c-bbfe-a2a69d042766 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1714 microversion: 2.1 time: 0.217262 Aug 01 14:28:45.586782 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 519/1027] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:45 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1714 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:45.925750 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-39f94fac-7436-4bff-912e-4b70f9b2a344 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:45.926358 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-39f94fac-7436-4bff-912e-4b70f9b2a344 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:45.933001 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-39f94fac-7436-4bff-912e-4b70f9b2a344 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:45.933453 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-39f94fac-7436-4bff-912e-4b70f9b2a344 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:45.934221 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-39f94fac-7436-4bff-912e-4b70f9b2a344 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:45.934657 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-39f94fac-7436-4bff-912e-4b70f9b2a344 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:46.068516 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-39f94fac-7436-4bff-912e-4b70f9b2a344 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:46.076618 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-39f94fac-7436-4bff-912e-4b70f9b2a344 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1260 microversion: 2.1 time: 0.154806 Aug 01 14:28:46.077377 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 509/1028] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:45 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:47.098283 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4c2a8afe-2169-4210-a093-c7707d0e671e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:47.098880 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4c2a8afe-2169-4210-a093-c7707d0e671e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:47.105414 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4c2a8afe-2169-4210-a093-c7707d0e671e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:47.106374 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4c2a8afe-2169-4210-a093-c7707d0e671e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:47.107128 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4c2a8afe-2169-4210-a093-c7707d0e671e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:47.107598 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4c2a8afe-2169-4210-a093-c7707d0e671e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:47.240962 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4c2a8afe-2169-4210-a093-c7707d0e671e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:47.248686 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4c2a8afe-2169-4210-a093-c7707d0e671e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1260 microversion: 2.1 time: 0.154657 Aug 01 14:28:47.249254 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 520/1029] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:47 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:48.269736 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-84984c68-5bd2-4002-beb6-a23fb3dc6ea1 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:48.270405 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-84984c68-5bd2-4002-beb6-a23fb3dc6ea1 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:48.277829 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-84984c68-5bd2-4002-beb6-a23fb3dc6ea1 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:48.278270 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-84984c68-5bd2-4002-beb6-a23fb3dc6ea1 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:48.279744 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-84984c68-5bd2-4002-beb6-a23fb3dc6ea1 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:48.280178 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-84984c68-5bd2-4002-beb6-a23fb3dc6ea1 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:48.418677 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-84984c68-5bd2-4002-beb6-a23fb3dc6ea1 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:48.426376 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-84984c68-5bd2-4002-beb6-a23fb3dc6ea1 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1260 microversion: 2.1 time: 0.160448 Aug 01 14:28:48.426951 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 510/1030] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:48 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:49.447835 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4c1d7b91-92cf-4442-bd5e-0e2f0f8ccad4 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:49.448483 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4c1d7b91-92cf-4442-bd5e-0e2f0f8ccad4 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:49.455029 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4c1d7b91-92cf-4442-bd5e-0e2f0f8ccad4 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:49.455503 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4c1d7b91-92cf-4442-bd5e-0e2f0f8ccad4 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:49.456274 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4c1d7b91-92cf-4442-bd5e-0e2f0f8ccad4 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:49.456705 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4c1d7b91-92cf-4442-bd5e-0e2f0f8ccad4 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:49.589843 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4c1d7b91-92cf-4442-bd5e-0e2f0f8ccad4 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:49.598125 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4c1d7b91-92cf-4442-bd5e-0e2f0f8ccad4 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1260 microversion: 2.1 time: 0.154144 Aug 01 14:28:49.598682 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 521/1031] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:49 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:50.618212 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-96520d96-2dfa-409e-ae6d-a815a6dae717 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:50.618801 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-96520d96-2dfa-409e-ae6d-a815a6dae717 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:50.621148 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:50.622033 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=6 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:50.628052 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-96520d96-2dfa-409e-ae6d-a815a6dae717 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:50.628506 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-96520d96-2dfa-409e-ae6d-a815a6dae717 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:50.629277 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-96520d96-2dfa-409e-ae6d-a815a6dae717 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:50.629712 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-96520d96-2dfa-409e-ae6d-a815a6dae717 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:50.771915 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-96520d96-2dfa-409e-ae6d-a815a6dae717 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:50.779778 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-96520d96-2dfa-409e-ae6d-a815a6dae717 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1260 microversion: 2.1 time: 0.165306 Aug 01 14:28:50.780371 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 511/1032] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:50 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:51.800620 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c6749ba3-def1-435c-b8d5-d564b6ef9813 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:51.801237 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c6749ba3-def1-435c-b8d5-d564b6ef9813 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:51.803212 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=2 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:51.809090 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c6749ba3-def1-435c-b8d5-d564b6ef9813 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:51.809536 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c6749ba3-def1-435c-b8d5-d564b6ef9813 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:51.810817 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c6749ba3-def1-435c-b8d5-d564b6ef9813 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:51.811247 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c6749ba3-def1-435c-b8d5-d564b6ef9813 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:51.942829 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c6749ba3-def1-435c-b8d5-d564b6ef9813 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:51.950278 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c6749ba3-def1-435c-b8d5-d564b6ef9813 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1260 microversion: 2.1 time: 0.153531 Aug 01 14:28:51.951425 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 522/1033] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:51 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:52.975059 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f7c1fbe2-904e-4666-8c07-9901ec0af97b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:52.976386 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f7c1fbe2-904e-4666-8c07-9901ec0af97b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:52.988735 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f7c1fbe2-904e-4666-8c07-9901ec0af97b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:52.989540 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f7c1fbe2-904e-4666-8c07-9901ec0af97b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:52.990897 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f7c1fbe2-904e-4666-8c07-9901ec0af97b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:52.991682 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f7c1fbe2-904e-4666-8c07-9901ec0af97b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:53.170643 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f7c1fbe2-904e-4666-8c07-9901ec0af97b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:53.179733 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f7c1fbe2-904e-4666-8c07-9901ec0af97b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1260 microversion: 2.1 time: 0.211578 Aug 01 14:28:53.180323 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 512/1034] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:52 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:28:54.201841 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-215db8d2-cf7c-4e00-b9f1-516067f53e6b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:54.202514 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-215db8d2-cf7c-4e00-b9f1-516067f53e6b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:54.218089 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-215db8d2-cf7c-4e00-b9f1-516067f53e6b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:54.218548 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-215db8d2-cf7c-4e00-b9f1-516067f53e6b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:54.219418 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-215db8d2-cf7c-4e00-b9f1-516067f53e6b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:54.219905 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-215db8d2-cf7c-4e00-b9f1-516067f53e6b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:54.378287 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-215db8d2-cf7c-4e00-b9f1-516067f53e6b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:54.385838 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-215db8d2-cf7c-4e00-b9f1-516067f53e6b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1260 microversion: 2.1 time: 0.188481 Aug 01 14:28:54.386405 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 523/1035] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:54 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:54.461259 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-a13a1df7-e311-4c99-9b9e-70229e2295bb req-2c9bb8b0-1678-4b18-84b1-1ee991ac929c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e51815a-0d9e-494f-8960-a75433080b70", "name": "network-vif-plugged", "status": "completed", "tag": "4bdcf192-f56a-4ae6-a4bb-17090119b4d9"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:28:54.474517 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-a13a1df7-e311-4c99-9b9e-70229e2295bb req-2c9bb8b0-1678-4b18-84b1-1ee991ac929c service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:54.475069 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-a13a1df7-e311-4c99-9b9e-70229e2295bb req-2c9bb8b0-1678-4b18-84b1-1ee991ac929c service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:54.486276 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-a13a1df7-e311-4c99-9b9e-70229e2295bb req-2c9bb8b0-1678-4b18-84b1-1ee991ac929c service nova] Creating event network-vif-plugged:4bdcf192-f56a-4ae6-a4bb-17090119b4d9 for instance 3e51815a-0d9e-494f-8960-a75433080b70 on hv-cinder-84599 Aug 01 14:28:54.491385 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-a13a1df7-e311-4c99-9b9e-70229e2295bb req-2c9bb8b0-1678-4b18-84b1-1ee991ac929c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033890 Aug 01 14:28:54.492377 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 513/1036] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:28:55.406853 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9bc19632-2052-4af3-8223-b5645ad7aa48 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:55.407447 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9bc19632-2052-4af3-8223-b5645ad7aa48 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:55.414634 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9bc19632-2052-4af3-8223-b5645ad7aa48 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:55.415129 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9bc19632-2052-4af3-8223-b5645ad7aa48 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:55.415878 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9bc19632-2052-4af3-8223-b5645ad7aa48 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:55.416295 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9bc19632-2052-4af3-8223-b5645ad7aa48 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:55.556945 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9bc19632-2052-4af3-8223-b5645ad7aa48 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:55.564949 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9bc19632-2052-4af3-8223-b5645ad7aa48 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1260 microversion: 2.1 time: 0.161958 Aug 01 14:28:55.565514 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 524/1037] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:55 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:56.587332 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-402a5086-4d5a-4cbd-b630-1af0be33e4f2 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:56.588060 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-402a5086-4d5a-4cbd-b630-1af0be33e4f2 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:56.595102 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-402a5086-4d5a-4cbd-b630-1af0be33e4f2 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:56.595588 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-402a5086-4d5a-4cbd-b630-1af0be33e4f2 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:56.596403 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-402a5086-4d5a-4cbd-b630-1af0be33e4f2 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:56.597103 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-402a5086-4d5a-4cbd-b630-1af0be33e4f2 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:56.734053 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-402a5086-4d5a-4cbd-b630-1af0be33e4f2 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:56.741956 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-402a5086-4d5a-4cbd-b630-1af0be33e4f2 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1445 microversion: 2.1 time: 0.159070 Aug 01 14:28:56.742523 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 514/1038] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:56 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1445 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:56.762467 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3eeedea8-aaa9-4fb3-bb23-13c21b37951d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:56.763072 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3eeedea8-aaa9-4fb3-bb23-13c21b37951d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:56.770073 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3eeedea8-aaa9-4fb3-bb23-13c21b37951d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:56.770516 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3eeedea8-aaa9-4fb3-bb23-13c21b37951d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:56.771272 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3eeedea8-aaa9-4fb3-bb23-13c21b37951d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:56.771730 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3eeedea8-aaa9-4fb3-bb23-13c21b37951d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:56.913693 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3eeedea8-aaa9-4fb3-bb23-13c21b37951d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:56.922815 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3eeedea8-aaa9-4fb3-bb23-13c21b37951d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1445 microversion: 2.1 time: 0.164064 Aug 01 14:28:56.923549 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 525/1039] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:56 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1445 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:58.911517 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-d5aaf0b2-eaa4-4e01-a845-dbf496a3ed48 req-7d70a11f-ed10-4064-a045-0ca3921ee3b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e51815a-0d9e-494f-8960-a75433080b70", "tag": "4bdcf192-f56a-4ae6-a4bb-17090119b4d9"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:28:58.921782 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-d5aaf0b2-eaa4-4e01-a845-dbf496a3ed48 req-7d70a11f-ed10-4064-a045-0ca3921ee3b7 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:58.922230 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-d5aaf0b2-eaa4-4e01-a845-dbf496a3ed48 req-7d70a11f-ed10-4064-a045-0ca3921ee3b7 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:58.945530 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-d5aaf0b2-eaa4-4e01-a845-dbf496a3ed48 req-7d70a11f-ed10-4064-a045-0ca3921ee3b7 service nova] Creating event network-changed:4bdcf192-f56a-4ae6-a4bb-17090119b4d9 for instance 3e51815a-0d9e-494f-8960-a75433080b70 on hv-cinder-84599 Aug 01 14:28:58.950560 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-d5aaf0b2-eaa4-4e01-a845-dbf496a3ed48 req-7d70a11f-ed10-4064-a045-0ca3921ee3b7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043198 Aug 01 14:28:58.951807 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 515/1040] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:29:20.930630 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3e279d4b-7760-4883-938d-2122515a74e6 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:20.931239 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3e279d4b-7760-4883-938d-2122515a74e6 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:20.933144 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=29 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:29:20.933787 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:29:20.939433 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3e279d4b-7760-4883-938d-2122515a74e6 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:20.939897 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3e279d4b-7760-4883-938d-2122515a74e6 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:20.940664 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3e279d4b-7760-4883-938d-2122515a74e6 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:20.941641 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3e279d4b-7760-4883-938d-2122515a74e6 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:21.027964 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-3e279d4b-7760-4883-938d-2122515a74e6 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lazy-loading 'services' on Instance uuid 32de816e-958f-4d99-a8cf-dc7f5522cf22 {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:29:21.107641 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3e279d4b-7760-4883-938d-2122515a74e6 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "DELETE /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22/os-volume_attachments/710c06a4-4d54-446d-ac5c-99b256271c6c" status: 202 len: 0 microversion: 2.1 time: 0.180904 Aug 01 14:29:21.108868 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 526/1041] 10.222.0.17 () {58 vars in 1416 bytes} [Mon Aug 1 14:29:20 2022] DELETE /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22/os-volume_attachments/710c06a4-4d54-446d-ac5c-99b256271c6c => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:29:22.255345 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:29:22.256340 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=90 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:29:22.263004 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c7d6f670-9f59-4882-92a9-99d0a02e673b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:29:22.274680 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c7d6f670-9f59-4882-92a9-99d0a02e673b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:22.275433 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c7d6f670-9f59-4882-92a9-99d0a02e673b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:22.303597 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c7d6f670-9f59-4882-92a9-99d0a02e673b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Going to try to stop instance {{(pid=118133) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 01 14:29:22.360746 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c7d6f670-9f59-4882-92a9-99d0a02e673b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "POST /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22/action" status: 202 len: 0 microversion: 2.1 time: 0.106838 Aug 01 14:29:22.361654 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 516/1042] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Aug 1 14:29:22 2022] POST /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:29:22.370925 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-45056465-74ed-426e-8e42-0f2fbfeda005 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:22.371879 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-45056465-74ed-426e-8e42-0f2fbfeda005 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:22.386171 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-45056465-74ed-426e-8e42-0f2fbfeda005 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:22.386630 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-45056465-74ed-426e-8e42-0f2fbfeda005 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:22.387435 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-45056465-74ed-426e-8e42-0f2fbfeda005 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:22.387893 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-45056465-74ed-426e-8e42-0f2fbfeda005 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:22.532848 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-45056465-74ed-426e-8e42-0f2fbfeda005 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:22.540842 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-45056465-74ed-426e-8e42-0f2fbfeda005 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1678 microversion: 2.1 time: 0.174697 Aug 01 14:29:22.541410 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 527/1043] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:22 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:23.563565 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-190027c0-4694-4042-b85b-481da095e000 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:23.564283 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-190027c0-4694-4042-b85b-481da095e000 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:23.570678 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-190027c0-4694-4042-b85b-481da095e000 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:23.571126 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-190027c0-4694-4042-b85b-481da095e000 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:23.571943 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-190027c0-4694-4042-b85b-481da095e000 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:23.572378 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-190027c0-4694-4042-b85b-481da095e000 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:23.713600 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-190027c0-4694-4042-b85b-481da095e000 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:23.721391 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-190027c0-4694-4042-b85b-481da095e000 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1678 microversion: 2.1 time: 0.162569 Aug 01 14:29:23.721973 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 517/1044] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:23 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:24.743521 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c0b48ddd-d78a-44dc-b521-b7d2d92f997f tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:24.744133 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c0b48ddd-d78a-44dc-b521-b7d2d92f997f tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:24.751568 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c0b48ddd-d78a-44dc-b521-b7d2d92f997f tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:24.752019 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c0b48ddd-d78a-44dc-b521-b7d2d92f997f tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:24.752774 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c0b48ddd-d78a-44dc-b521-b7d2d92f997f tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:24.753196 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c0b48ddd-d78a-44dc-b521-b7d2d92f997f tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:24.893003 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c0b48ddd-d78a-44dc-b521-b7d2d92f997f tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:24.901982 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c0b48ddd-d78a-44dc-b521-b7d2d92f997f tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1678 microversion: 2.1 time: 0.162340 Aug 01 14:29:24.902630 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 528/1045] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:24 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:25.925476 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-57037b67-8773-4032-9cc5-f796fb99f7a4 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:25.926062 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-57037b67-8773-4032-9cc5-f796fb99f7a4 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:25.932785 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-57037b67-8773-4032-9cc5-f796fb99f7a4 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:25.933278 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-57037b67-8773-4032-9cc5-f796fb99f7a4 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:25.934226 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-57037b67-8773-4032-9cc5-f796fb99f7a4 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:25.934624 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-57037b67-8773-4032-9cc5-f796fb99f7a4 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:26.076286 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-57037b67-8773-4032-9cc5-f796fb99f7a4 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:26.085161 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-57037b67-8773-4032-9cc5-f796fb99f7a4 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1678 microversion: 2.1 time: 0.164702 Aug 01 14:29:26.085732 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 518/1046] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:25 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:29:27.107619 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8485efbb-04c0-46e5-89b7-71673abae81e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:27.108644 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-8485efbb-04c0-46e5-89b7-71673abae81e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:27.115587 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8485efbb-04c0-46e5-89b7-71673abae81e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:27.116117 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8485efbb-04c0-46e5-89b7-71673abae81e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:27.117016 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8485efbb-04c0-46e5-89b7-71673abae81e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:27.117492 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8485efbb-04c0-46e5-89b7-71673abae81e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:27.270263 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-8485efbb-04c0-46e5-89b7-71673abae81e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:27.282715 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8485efbb-04c0-46e5-89b7-71673abae81e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1678 microversion: 2.1 time: 0.178760 Aug 01 14:29:27.283596 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 529/1047] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:27 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:29:28.316145 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3a5b8c35-749c-4e19-b27a-e148d7934b35 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:28.316981 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3a5b8c35-749c-4e19-b27a-e148d7934b35 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:28.323588 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3a5b8c35-749c-4e19-b27a-e148d7934b35 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:28.324042 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3a5b8c35-749c-4e19-b27a-e148d7934b35 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:28.324818 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3a5b8c35-749c-4e19-b27a-e148d7934b35 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:28.325256 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3a5b8c35-749c-4e19-b27a-e148d7934b35 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:28.459257 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3a5b8c35-749c-4e19-b27a-e148d7934b35 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:28.466970 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3a5b8c35-749c-4e19-b27a-e148d7934b35 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1678 microversion: 2.1 time: 0.154798 Aug 01 14:29:28.467569 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 519/1048] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:28 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:29.490582 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-add9635b-651d-4cde-999e-1ece9c4dc473 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:29.491292 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-add9635b-651d-4cde-999e-1ece9c4dc473 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:29.498083 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-add9635b-651d-4cde-999e-1ece9c4dc473 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:29.498578 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-add9635b-651d-4cde-999e-1ece9c4dc473 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:29.499350 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-add9635b-651d-4cde-999e-1ece9c4dc473 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:29.499818 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-add9635b-651d-4cde-999e-1ece9c4dc473 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:29.649099 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-add9635b-651d-4cde-999e-1ece9c4dc473 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:29.657493 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-add9635b-651d-4cde-999e-1ece9c4dc473 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1678 microversion: 2.1 time: 0.172057 Aug 01 14:29:29.658099 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 530/1049] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:29 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:30.680067 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-beb9e38f-b521-4b22-a2a9-b13e9bf989d9 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:30.680672 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-beb9e38f-b521-4b22-a2a9-b13e9bf989d9 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:30.687438 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-beb9e38f-b521-4b22-a2a9-b13e9bf989d9 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:30.687917 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-beb9e38f-b521-4b22-a2a9-b13e9bf989d9 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:30.688696 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-beb9e38f-b521-4b22-a2a9-b13e9bf989d9 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:30.689124 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-beb9e38f-b521-4b22-a2a9-b13e9bf989d9 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:30.822558 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-beb9e38f-b521-4b22-a2a9-b13e9bf989d9 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:30.830518 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-beb9e38f-b521-4b22-a2a9-b13e9bf989d9 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1678 microversion: 2.1 time: 0.154633 Aug 01 14:29:30.831104 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 520/1050] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:30 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:31.852745 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-599efc8f-a7d5-4a8e-b535-33bae40f4c73 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:31.853500 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-599efc8f-a7d5-4a8e-b535-33bae40f4c73 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:31.860228 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-599efc8f-a7d5-4a8e-b535-33bae40f4c73 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:31.860673 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-599efc8f-a7d5-4a8e-b535-33bae40f4c73 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:31.861440 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-599efc8f-a7d5-4a8e-b535-33bae40f4c73 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:31.861867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-599efc8f-a7d5-4a8e-b535-33bae40f4c73 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:32.002432 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-599efc8f-a7d5-4a8e-b535-33bae40f4c73 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:32.010170 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-599efc8f-a7d5-4a8e-b535-33bae40f4c73 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1678 microversion: 2.1 time: 0.161613 Aug 01 14:29:32.010737 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 531/1051] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:31 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:33.034471 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-21486ea9-dbd6-4a76-b8bd-a77c1dbdd4ac tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:33.035156 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-21486ea9-dbd6-4a76-b8bd-a77c1dbdd4ac tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:33.041665 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-21486ea9-dbd6-4a76-b8bd-a77c1dbdd4ac tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:33.042113 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-21486ea9-dbd6-4a76-b8bd-a77c1dbdd4ac tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:33.042874 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-21486ea9-dbd6-4a76-b8bd-a77c1dbdd4ac tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:33.043303 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-21486ea9-dbd6-4a76-b8bd-a77c1dbdd4ac tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:33.180657 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-21486ea9-dbd6-4a76-b8bd-a77c1dbdd4ac tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:33.189080 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-21486ea9-dbd6-4a76-b8bd-a77c1dbdd4ac tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1655 microversion: 2.1 time: 0.158470 Aug 01 14:29:33.189665 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 521/1052] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:33 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1655 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:33.210030 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ba9829b5-7864-41c6-b623-937f67312a3b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:29:33.216532 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ba9829b5-7864-41c6-b623-937f67312a3b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:33.216986 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ba9829b5-7864-41c6-b623-937f67312a3b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:33.239838 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ba9829b5-7864-41c6-b623-937f67312a3b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Going to try to start instance {{(pid=118132) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 01 14:29:33.283741 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ba9829b5-7864-41c6-b623-937f67312a3b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "POST /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22/action" status: 202 len: 0 microversion: 2.1 time: 0.077199 Aug 01 14:29:33.284325 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 532/1053] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Aug 1 14:29:33 2022] POST /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:29:33.294682 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-72f33346-e593-4113-b0eb-6f88124489d2 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:33.295865 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-72f33346-e593-4113-b0eb-6f88124489d2 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:33.302884 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-72f33346-e593-4113-b0eb-6f88124489d2 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:33.303326 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-72f33346-e593-4113-b0eb-6f88124489d2 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:33.304230 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-72f33346-e593-4113-b0eb-6f88124489d2 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:33.304674 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-72f33346-e593-4113-b0eb-6f88124489d2 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:33.448324 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-72f33346-e593-4113-b0eb-6f88124489d2 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:33.456773 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-72f33346-e593-4113-b0eb-6f88124489d2 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1664 microversion: 2.1 time: 0.167500 Aug 01 14:29:33.465982 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 522/1054] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:33 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1664 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:34.479105 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b718b8ee-3d92-4cf3-a20c-5efbb9e3e188 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:34.479836 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b718b8ee-3d92-4cf3-a20c-5efbb9e3e188 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:34.486665 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b718b8ee-3d92-4cf3-a20c-5efbb9e3e188 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:34.487113 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b718b8ee-3d92-4cf3-a20c-5efbb9e3e188 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:34.487906 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b718b8ee-3d92-4cf3-a20c-5efbb9e3e188 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:34.488341 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b718b8ee-3d92-4cf3-a20c-5efbb9e3e188 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:34.636493 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b718b8ee-3d92-4cf3-a20c-5efbb9e3e188 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:34.644557 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b718b8ee-3d92-4cf3-a20c-5efbb9e3e188 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1664 microversion: 2.1 time: 0.169620 Aug 01 14:29:34.645156 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 533/1055] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:34 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1664 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:35.666218 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-573b8edd-d1c5-4acc-80f0-11cfec58317b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:35.666821 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-573b8edd-d1c5-4acc-80f0-11cfec58317b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:35.674049 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-573b8edd-d1c5-4acc-80f0-11cfec58317b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:35.674426 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-573b8edd-d1c5-4acc-80f0-11cfec58317b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:35.675180 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-573b8edd-d1c5-4acc-80f0-11cfec58317b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:35.675642 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-573b8edd-d1c5-4acc-80f0-11cfec58317b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:35.817272 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-573b8edd-d1c5-4acc-80f0-11cfec58317b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:35.825683 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-573b8edd-d1c5-4acc-80f0-11cfec58317b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1668 microversion: 2.1 time: 0.163361 Aug 01 14:29:35.826298 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 523/1056] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:35 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:08.731485 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-00a2346c-4c70-405d-b6bf-d88271e36b3d tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:08.734481 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-00a2346c-4c70-405d-b6bf-d88271e36b3d tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:08.737050 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=16 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:08.738220 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:08.744532 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-00a2346c-4c70-405d-b6bf-d88271e36b3d tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:08.744984 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-00a2346c-4c70-405d-b6bf-d88271e36b3d tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:08.745758 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-00a2346c-4c70-405d-b6bf-d88271e36b3d tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:08.746192 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-00a2346c-4c70-405d-b6bf-d88271e36b3d tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:08.778416 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-00a2346c-4c70-405d-b6bf-d88271e36b3d tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051943 Aug 01 14:30:08.778974 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 534/1057] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Aug 1 14:30:08 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:30:08.842793 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-70d18c0f-0338-4964-b6fc-05c288395731 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:08.843363 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-70d18c0f-0338-4964-b6fc-05c288395731 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:08.845687 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=16 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:08.846488 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:08.853036 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-70d18c0f-0338-4964-b6fc-05c288395731 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:08.853481 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-70d18c0f-0338-4964-b6fc-05c288395731 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:08.854247 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-70d18c0f-0338-4964-b6fc-05c288395731 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:08.854676 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-70d18c0f-0338-4964-b6fc-05c288395731 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:08.882626 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-70d18c0f-0338-4964-b6fc-05c288395731 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Going to try to terminate instance {{(pid=118133) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:30:08.968973 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-70d18c0f-0338-4964-b6fc-05c288395731 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "DELETE /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 204 len: 0 microversion: 2.1 time: 0.129661 Aug 01 14:30:08.970386 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 524/1058] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Aug 1 14:30:08 2022] DELETE /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:30:08.979317 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a217ada4-f3fc-4621-a96d-42e97fc5af18 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:08.979981 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a217ada4-f3fc-4621-a96d-42e97fc5af18 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:08.986745 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a217ada4-f3fc-4621-a96d-42e97fc5af18 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:08.987219 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a217ada4-f3fc-4621-a96d-42e97fc5af18 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:08.988002 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a217ada4-f3fc-4621-a96d-42e97fc5af18 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:08.988451 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a217ada4-f3fc-4621-a96d-42e97fc5af18 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:09.123571 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a217ada4-f3fc-4621-a96d-42e97fc5af18 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:09.131368 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a217ada4-f3fc-4621-a96d-42e97fc5af18 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1674 microversion: 2.1 time: 0.156275 Aug 01 14:30:09.131997 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 535/1059] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:08 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:10.153952 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6952a0eb-efc7-418f-bcc3-c35564958873 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:10.154648 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-6952a0eb-efc7-418f-bcc3-c35564958873 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:10.161948 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6952a0eb-efc7-418f-bcc3-c35564958873 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:10.162393 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6952a0eb-efc7-418f-bcc3-c35564958873 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:10.163177 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6952a0eb-efc7-418f-bcc3-c35564958873 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:10.163643 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6952a0eb-efc7-418f-bcc3-c35564958873 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:10.303677 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6952a0eb-efc7-418f-bcc3-c35564958873 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:10.311303 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6952a0eb-efc7-418f-bcc3-c35564958873 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1674 microversion: 2.1 time: 0.161617 Aug 01 14:30:10.311947 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 525/1060] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:10 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:11.335554 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3ff92d94-2e6c-4c4f-992e-7f38b81feae0 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:11.336148 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3ff92d94-2e6c-4c4f-992e-7f38b81feae0 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:11.342382 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3ff92d94-2e6c-4c4f-992e-7f38b81feae0 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:11.342840 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3ff92d94-2e6c-4c4f-992e-7f38b81feae0 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:11.344222 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3ff92d94-2e6c-4c4f-992e-7f38b81feae0 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:11.344656 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3ff92d94-2e6c-4c4f-992e-7f38b81feae0 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:11.840254 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3ff92d94-2e6c-4c4f-992e-7f38b81feae0 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:11.849216 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3ff92d94-2e6c-4c4f-992e-7f38b81feae0 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1674 microversion: 2.1 time: 0.518047 Aug 01 14:30:11.849898 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 536/1061] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:11 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1674 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:30:12.461278 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-29870d9b-e27a-457e-aa57-3b6b99c30e7c req-226dfde3-2454-4eac-8cac-7f6749874a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32de816e-958f-4d99-a8cf-dc7f5522cf22", "name": "network-vif-deleted", "tag": "d37f6e4c-b84c-4a23-bf23-c8d4f230dc2d"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:30:12.476358 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-29870d9b-e27a-457e-aa57-3b6b99c30e7c req-226dfde3-2454-4eac-8cac-7f6749874a36 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:12.476816 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-29870d9b-e27a-457e-aa57-3b6b99c30e7c req-226dfde3-2454-4eac-8cac-7f6749874a36 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:12.491675 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-29870d9b-e27a-457e-aa57-3b6b99c30e7c req-226dfde3-2454-4eac-8cac-7f6749874a36 service nova] Creating event network-vif-deleted:d37f6e4c-b84c-4a23-bf23-c8d4f230dc2d for instance 32de816e-958f-4d99-a8cf-dc7f5522cf22 on hv-cinder-84599 Aug 01 14:30:12.512427 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-29870d9b-e27a-457e-aa57-3b6b99c30e7c req-226dfde3-2454-4eac-8cac-7f6749874a36 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054762 Aug 01 14:30:12.513502 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 526/1062] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:30:12.870354 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6a940f8f-05e7-407e-94a8-e93558d1a611 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:12.870975 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-6a940f8f-05e7-407e-94a8-e93558d1a611 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:12.877900 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6a940f8f-05e7-407e-94a8-e93558d1a611 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:12.878341 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6a940f8f-05e7-407e-94a8-e93558d1a611 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:12.879115 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6a940f8f-05e7-407e-94a8-e93558d1a611 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:12.879604 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6a940f8f-05e7-407e-94a8-e93558d1a611 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:12.914894 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6a940f8f-05e7-407e-94a8-e93558d1a611 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:12.915335 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6a940f8f-05e7-407e-94a8-e93558d1a611 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:12.915812 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-6a940f8f-05e7-407e-94a8-e93558d1a611 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lazy-loading 'fault' on Instance uuid 32de816e-958f-4d99-a8cf-dc7f5522cf22 {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:30:13.124104 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6a940f8f-05e7-407e-94a8-e93558d1a611 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:13.133663 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6a940f8f-05e7-407e-94a8-e93558d1a611 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 200 len: 1328 microversion: 2.1 time: 0.267173 Aug 01 14:30:13.134253 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 537/1063] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:12 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 1328 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:14.156378 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-df78e5ba-31d4-46c6-8cd7-ecb46ccc5ff4 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:14.157088 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-df78e5ba-31d4-46c6-8cd7-ecb46ccc5ff4 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:14.163934 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-df78e5ba-31d4-46c6-8cd7-ecb46ccc5ff4 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:14.164388 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-df78e5ba-31d4-46c6-8cd7-ecb46ccc5ff4 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:14.165206 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-df78e5ba-31d4-46c6-8cd7-ecb46ccc5ff4 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:14.165650 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-df78e5ba-31d4-46c6-8cd7-ecb46ccc5ff4 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:14.180022 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-df78e5ba-31d4-46c6-8cd7-ecb46ccc5ff4 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] HTTP exception thrown: Instance 32de816e-958f-4d99-a8cf-dc7f5522cf22 could not be found. Aug 01 14:30:14.181672 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-df78e5ba-31d4-46c6-8cd7-ecb46ccc5ff4 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Request method failure captured: Aug 01 14:30:14.181672 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 HTTP/1.1 Aug 01 14:30:14.181672 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:30:14.181672 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:30:14.181672 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:30:14.181672 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 0 Aug 01 14:30:14.181672 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:30:14.181672 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:30:14.181672 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:30:14.181672 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:30:14.181672 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-K78faWMgu8mzA4Eg8pgsiGxTE6pBXhmPQojigyrNjIMs1R9adp28mi7VvKThaG50jD5wKdwDz7gzAJrj7AtVL0Rk_xR189lfsf40Nm3HxixhapJZjfNBrZScoAKOd8VMLb2ykHjXYrSPq9SiJe7buVp5udlI1E05AGLj0LDk6Nq5Q Aug 01 14:30:14.181672 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:30:14.181672 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:30:14.181672 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:30:14.181672 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:30:14.181672 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:30:14.181672 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:30:14.181672 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: 00a93cc41a184683a1fb82acfa2660a6 Aug 01 14:30:14.181672 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-AttachVolumeTestJSON-69766420 Aug 01 14:30:14.181672 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:30:14.181672 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:30:14.183382 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/00a93cc41a184683a1fb82acfa2660a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/00a93cc41a184683a1fb82acfa2660a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/00a93cc41a184683a1fb82acfa2660a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_00a93cc41a184683a1fb82acfa2660a6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:30:14.183382 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-AttachVolumeTestJSON-69766420 Aug 01 14:30:14.183382 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 00a93cc41a184683a1fb82acfa2660a6 Aug 01 14:30:14.183382 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-AttachVolumeTestJSON-69766420 Aug 01 14:30:14.183382 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-AttachVolumeTestJSON-69766420-project Aug 01 14:30:14.183382 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:30:14.183382 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:30:14.183382 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: 4079529de70f4994ab9f1f3dd5cb3fd7 Aug 01 14:30:14.183382 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-AttachVolumeTestJSON-69766420-project Aug 01 14:30:14.183382 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: > Aug 01 14:30:14.183382 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Instance 32de816e-958f-4d99-a8cf-dc7f5522cf22 could not be found. Aug 01 14:30:14.183382 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'id': '32de816e-958f-4d99-a8cf-dc7f5522cf22'} Aug 01 14:30:14.184380 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:30:14.184380 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:30:14.184380 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:30:14.184380 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:30:14.184380 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:30:14.184380 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:30:14.184380 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:30:14.184380 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:30:14.184380 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:30:14.184380 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:30:14.184380 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32de816e-958f-4d99-a8cf-dc7f5522cf22 could not be found. Aug 01 14:30:14.184380 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:30:14.184380 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:30:14.184380 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:30:14.184380 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:30:14.184380 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:30:14.184380 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:30:14.184380 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:30:14.184380 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:30:14.184380 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:30:14.185988 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:30:14.185988 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:30:14.185988 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:30:14.185988 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:30:14.185988 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:30:14.185988 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:30:14.185988 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:30:14.185988 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32de816e-958f-4d99-a8cf-dc7f5522cf22 could not be found. Aug 01 14:30:14.185988 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:30:14.185988 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:30:14.185988 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:30:14.185988 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:30:14.185988 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:30:14.185988 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:30:14.185988 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:30:14.185988 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:30:14.185988 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32de816e-958f-4d99-a8cf-dc7f5522cf22 could not be found. Aug 01 14:30:14.185988 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:30:14.187432 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-df78e5ba-31d4-46c6-8cd7-ecb46ccc5ff4 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Returning 404 to user: Instance 32de816e-958f-4d99-a8cf-dc7f5522cf22 could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:30:14.187432 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-df78e5ba-31d4-46c6-8cd7-ecb46ccc5ff4 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 404 len: 111 microversion: 2.1 time: 0.031630 Aug 01 14:30:14.187432 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 527/1064] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:14 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:30:14.192354 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7f8911f1-f25a-4fda-a46d-cb24819921ad tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '.version_select at 0x7f6184c9a4c0>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:14.197030 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7f8911f1-f25a-4fda-a46d-cb24819921ad tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [914ba685-ffb3-4458-97ed-ee964a874d39] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 01 14:30:15.207446 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO oslo.messaging._drivers.impl_rabbit [None req-7f8911f1-f25a-4fda-a46d-cb24819921ad tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [914ba685-ffb3-4458-97ed-ee964a874d39] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 54810. Aug 01 14:30:15.230563 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7f8911f1-f25a-4fda-a46d-cb24819921ad tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1553627280" status: 202 len: 0 microversion: 2.1 time: 1.041903 Aug 01 14:30:15.231060 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 538/1065] 10.222.0.17 () {58 vars in 1221 bytes} [Mon Aug 1 14:30:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1553627280 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:30:15.986144 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-edd0efec-37ff-4a85-8e19-af48d869b810 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Action: 'create', calling method: .version_select at 0x7f6185dbc820>, body: {"keypair": {"name": "tempest-keypair-428064898", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENM18G9NIcG5nsKGU5LH3tx8elJIWx+gwlrDdt0qtUQ2o6M24EoHZbw/NM5dS4e67SNXrynQIRz1AB/9VczQHyiMWrWYMxWtAb2rSNV3zBR6hUVpHjwLVL4kiSCVs/oTw=="}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:30:16.003828 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-edd0efec-37ff-4a85-8e19-af48d869b810 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Getting quotas for project 00a93cc41a184683a1fb82acfa2660a6. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:30:16.007787 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-edd0efec-37ff-4a85-8e19-af48d869b810 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Getting quotas for user 4079529de70f4994ab9f1f3dd5cb3fd7 and project 00a93cc41a184683a1fb82acfa2660a6. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:30:16.031525 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-edd0efec-37ff-4a85-8e19-af48d869b810 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049966 Aug 01 14:30:16.032137 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 528/1066] 10.222.0.17 () {60 vars in 1159 bytes} [Mon Aug 1 14:30:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:30:17.486678 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-67106f83-c5ba-425f-b207-554becf51201 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-302071014", "imageRef": "9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38460461-e63e-4e2b-95c5-9581a1400ff6"}], "security_groups": [{"name": "tempest-securitygroup--1185971769"}], "key_name": "tempest-keypair-428064898", "user_data": "}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:30:17.627753 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.network.neutron [None req-67106f83-c5ba-425f-b207-554becf51201 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] validate_networks() for [('38460461-e63e-4e2b-95c5-9581a1400ff6', None, None, None, None, None)] {{(pid=118132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:30:18.052781 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-67106f83-c5ba-425f-b207-554becf51201 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Flavor limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:30:18.053252 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-67106f83-c5ba-425f-b207-554becf51201 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Image limits 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:30:18.053730 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-67106f83-c5ba-425f-b207-554becf51201 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Flavor pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:30:18.054134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-67106f83-c5ba-425f-b207-554becf51201 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Image pref 0:0:0 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:30:18.054559 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.virt.hardware [None req-67106f83-c5ba-425f-b207-554becf51201 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:30:18.067941 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-67106f83-c5ba-425f-b207-554becf51201 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:18.068383 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-67106f83-c5ba-425f-b207-554becf51201 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:18.069207 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-67106f83-c5ba-425f-b207-554becf51201 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:18.069638 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-67106f83-c5ba-425f-b207-554becf51201 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:18.087704 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-67106f83-c5ba-425f-b207-554becf51201 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Getting quotas for project 00a93cc41a184683a1fb82acfa2660a6. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:30:18.096978 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.quota [None req-67106f83-c5ba-425f-b207-554becf51201 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Getting quotas for user 4079529de70f4994ab9f1f3dd5cb3fd7 and project 00a93cc41a184683a1fb82acfa2660a6. Resources: {'instances', 'cores', 'ram'} {{(pid=118132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:30:18.109175 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-67106f83-c5ba-425f-b207-554becf51201 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Going to run 1 instances... {{(pid=118132) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:30:18.111445 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-67106f83-c5ba-425f-b207-554becf51201 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9548b4d9-2fc4-4fb7-81d1-b63818ebb1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:30:18.178446 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-67106f83-c5ba-425f-b207-554becf51201 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.697150 Aug 01 14:30:18.179499 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 539/1067] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Aug 1 14:30:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:30:18.191692 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f7904c7a-2df7-4ab7-a092-25710950e492 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:18.192505 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f7904c7a-2df7-4ab7-a092-25710950e492 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:18.333081 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f7904c7a-2df7-4ab7-a092-25710950e492 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:18.340402 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f7904c7a-2df7-4ab7-a092-25710950e492 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03" status: 200 len: 1236 microversion: 2.1 time: 0.153298 Aug 01 14:30:18.342359 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 529/1068] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:18 2022] GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03 => generated 1236 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:19.364702 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a36f6b9d-de73-46f3-82c4-a6473b42e144 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:19.365422 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a36f6b9d-de73-46f3-82c4-a6473b42e144 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:19.374247 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a36f6b9d-de73-46f3-82c4-a6473b42e144 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:19.374731 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a36f6b9d-de73-46f3-82c4-a6473b42e144 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:19.375525 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a36f6b9d-de73-46f3-82c4-a6473b42e144 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:19.375960 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a36f6b9d-de73-46f3-82c4-a6473b42e144 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:19.497853 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a36f6b9d-de73-46f3-82c4-a6473b42e144 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:19.512501 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a36f6b9d-de73-46f3-82c4-a6473b42e144 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03" status: 200 len: 1296 microversion: 2.1 time: 0.149838 Aug 01 14:30:19.512501 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 540/1069] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:19 2022] GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03 => generated 1296 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:20.533067 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-59028a12-0c30-49e7-b305-103edc6fe63b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:20.533738 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-59028a12-0c30-49e7-b305-103edc6fe63b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:20.540669 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-59028a12-0c30-49e7-b305-103edc6fe63b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:20.541042 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-59028a12-0c30-49e7-b305-103edc6fe63b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:20.541829 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-59028a12-0c30-49e7-b305-103edc6fe63b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:20.542298 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-59028a12-0c30-49e7-b305-103edc6fe63b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:20.727156 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-59028a12-0c30-49e7-b305-103edc6fe63b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:20.735678 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-59028a12-0c30-49e7-b305-103edc6fe63b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03" status: 200 len: 1362 microversion: 2.1 time: 0.207178 Aug 01 14:30:20.736271 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 530/1070] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:20 2022] GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:21.068449 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-2c429059-46ab-4be0-91c4-a9958ffec73d req-e3e57599-3c2b-4cd3-914a-1a8fece18136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09455b95-58be-4c8c-b8f4-5969ed769c03", "tag": "dc0ba090-64fe-4fe6-ab75-2767eeb3bdd9"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:30:21.086977 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-2c429059-46ab-4be0-91c4-a9958ffec73d req-e3e57599-3c2b-4cd3-914a-1a8fece18136 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:21.087710 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-2c429059-46ab-4be0-91c4-a9958ffec73d req-e3e57599-3c2b-4cd3-914a-1a8fece18136 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:21.099658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-2c429059-46ab-4be0-91c4-a9958ffec73d req-e3e57599-3c2b-4cd3-914a-1a8fece18136 service nova] Creating event network-changed:dc0ba090-64fe-4fe6-ab75-2767eeb3bdd9 for instance 09455b95-58be-4c8c-b8f4-5969ed769c03 on hv-cinder-84599 Aug 01 14:30:21.106002 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-2c429059-46ab-4be0-91c4-a9958ffec73d req-e3e57599-3c2b-4cd3-914a-1a8fece18136 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043416 Aug 01 14:30:21.107095 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 541/1071] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:30:21.757294 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ea10b597-40e6-494f-b659-e2c471f1e623 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:21.758089 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ea10b597-40e6-494f-b659-e2c471f1e623 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:21.764936 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ea10b597-40e6-494f-b659-e2c471f1e623 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:21.765897 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ea10b597-40e6-494f-b659-e2c471f1e623 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:21.766675 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ea10b597-40e6-494f-b659-e2c471f1e623 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:21.767119 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ea10b597-40e6-494f-b659-e2c471f1e623 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:21.907692 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ea10b597-40e6-494f-b659-e2c471f1e623 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:21.915334 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ea10b597-40e6-494f-b659-e2c471f1e623 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03" status: 200 len: 1362 microversion: 2.1 time: 0.162155 Aug 01 14:30:21.915940 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 531/1072] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:21 2022] GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:22.938033 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-50c4f674-40f2-4029-b562-0bc1e4fd4bfe tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:22.938740 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-50c4f674-40f2-4029-b562-0bc1e4fd4bfe tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:22.947071 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-50c4f674-40f2-4029-b562-0bc1e4fd4bfe tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:22.949638 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-50c4f674-40f2-4029-b562-0bc1e4fd4bfe tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:22.950471 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-50c4f674-40f2-4029-b562-0bc1e4fd4bfe tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:22.950914 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-50c4f674-40f2-4029-b562-0bc1e4fd4bfe tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:23.090429 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-50c4f674-40f2-4029-b562-0bc1e4fd4bfe tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:23.098458 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-50c4f674-40f2-4029-b562-0bc1e4fd4bfe tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03" status: 200 len: 1362 microversion: 2.1 time: 0.165342 Aug 01 14:30:23.099025 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 542/1073] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:22 2022] GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:24.120088 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6df0f92f-704f-429e-a997-e8ac4bd0d60e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:24.120712 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-6df0f92f-704f-429e-a997-e8ac4bd0d60e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:24.127521 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6df0f92f-704f-429e-a997-e8ac4bd0d60e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:24.127984 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6df0f92f-704f-429e-a997-e8ac4bd0d60e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:24.128760 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6df0f92f-704f-429e-a997-e8ac4bd0d60e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:24.129197 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6df0f92f-704f-429e-a997-e8ac4bd0d60e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:24.262332 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6df0f92f-704f-429e-a997-e8ac4bd0d60e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:24.269996 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6df0f92f-704f-429e-a997-e8ac4bd0d60e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03" status: 200 len: 1362 microversion: 2.1 time: 0.153643 Aug 01 14:30:24.270563 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 532/1074] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:24 2022] GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:25.290432 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9b1235e7-b920-439d-b0bb-d9f2424082c5 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:25.291021 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9b1235e7-b920-439d-b0bb-d9f2424082c5 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:25.300019 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9b1235e7-b920-439d-b0bb-d9f2424082c5 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:25.300534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9b1235e7-b920-439d-b0bb-d9f2424082c5 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:25.301349 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9b1235e7-b920-439d-b0bb-d9f2424082c5 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:25.301779 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9b1235e7-b920-439d-b0bb-d9f2424082c5 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:25.450949 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9b1235e7-b920-439d-b0bb-d9f2424082c5 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:25.458847 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9b1235e7-b920-439d-b0bb-d9f2424082c5 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03" status: 200 len: 1362 microversion: 2.1 time: 0.172135 Aug 01 14:30:25.459561 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 543/1075] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:25 2022] GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:26.484562 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9b9183ce-d2df-4a5f-ae6b-ab2754c770dd tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:26.485166 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9b9183ce-d2df-4a5f-ae6b-ab2754c770dd tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:26.491670 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9b9183ce-d2df-4a5f-ae6b-ab2754c770dd tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:26.492119 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9b9183ce-d2df-4a5f-ae6b-ab2754c770dd tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:26.492898 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9b9183ce-d2df-4a5f-ae6b-ab2754c770dd tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:26.493332 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9b9183ce-d2df-4a5f-ae6b-ab2754c770dd tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:26.636912 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9b9183ce-d2df-4a5f-ae6b-ab2754c770dd tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:26.647185 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9b9183ce-d2df-4a5f-ae6b-ab2754c770dd tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03" status: 200 len: 1362 microversion: 2.1 time: 0.166270 Aug 01 14:30:26.648314 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 533/1076] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:26 2022] GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:26.935410 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-87d99ec1-e50d-43bc-b6c9-94c6b30ea5b5 req-8ad71523-bc41-4e9a-80ce-98c76c45b842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09455b95-58be-4c8c-b8f4-5969ed769c03", "name": "network-vif-plugged", "status": "completed", "tag": "dc0ba090-64fe-4fe6-ab75-2767eeb3bdd9"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:30:26.955203 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-87d99ec1-e50d-43bc-b6c9-94c6b30ea5b5 req-8ad71523-bc41-4e9a-80ce-98c76c45b842 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:26.956214 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-87d99ec1-e50d-43bc-b6c9-94c6b30ea5b5 req-8ad71523-bc41-4e9a-80ce-98c76c45b842 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:26.980727 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-87d99ec1-e50d-43bc-b6c9-94c6b30ea5b5 req-8ad71523-bc41-4e9a-80ce-98c76c45b842 service nova] Creating event network-vif-plugged:dc0ba090-64fe-4fe6-ab75-2767eeb3bdd9 for instance 09455b95-58be-4c8c-b8f4-5969ed769c03 on hv-cinder-84599 Aug 01 14:30:26.991350 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-87d99ec1-e50d-43bc-b6c9-94c6b30ea5b5 req-8ad71523-bc41-4e9a-80ce-98c76c45b842 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063135 Aug 01 14:30:26.992673 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 544/1077] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:30:27.668143 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5aefadfd-f41c-402d-9902-67aa52713643 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:27.668739 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5aefadfd-f41c-402d-9902-67aa52713643 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:27.675614 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5aefadfd-f41c-402d-9902-67aa52713643 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:27.676061 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5aefadfd-f41c-402d-9902-67aa52713643 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:27.676835 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5aefadfd-f41c-402d-9902-67aa52713643 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:27.677270 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5aefadfd-f41c-402d-9902-67aa52713643 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:27.709285 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0297abb2-6382-4e5e-879f-40412f7a6604 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:27.709876 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0297abb2-6382-4e5e-879f-40412f7a6604 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: fb882cc8-dad4-4898-9d57-ba546c8b1068] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:27.716784 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0297abb2-6382-4e5e-879f-40412f7a6604 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:27.717030 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0297abb2-6382-4e5e-879f-40412f7a6604 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:27.717750 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0297abb2-6382-4e5e-879f-40412f7a6604 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:27.718185 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0297abb2-6382-4e5e-879f-40412f7a6604 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:27.745176 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0297abb2-6382-4e5e-879f-40412f7a6604 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: fb882cc8-dad4-4898-9d57-ba546c8b1068] Going to try to terminate instance {{(pid=118132) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:30:27.838625 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0297abb2-6382-4e5e-879f-40412f7a6604 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068" status: 204 len: 0 microversion: 2.1 time: 0.133705 Aug 01 14:30:27.839532 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 545/1078] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Aug 1 14:30:27 2022] DELETE /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 14:30:27.841153 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5aefadfd-f41c-402d-9902-67aa52713643 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:27.849281 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5aefadfd-f41c-402d-9902-67aa52713643 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03" status: 200 len: 1362 microversion: 2.1 time: 0.184659 Aug 01 14:30:27.850081 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 534/1079] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:27 2022] GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:27.850764 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-00980ad0-3294-48ef-b164-b9d00a18d103 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:27.852212 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-00980ad0-3294-48ef-b164-b9d00a18d103 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: fb882cc8-dad4-4898-9d57-ba546c8b1068] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:27.862963 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-00980ad0-3294-48ef-b164-b9d00a18d103 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:27.863628 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-00980ad0-3294-48ef-b164-b9d00a18d103 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:27.864901 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-00980ad0-3294-48ef-b164-b9d00a18d103 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:27.865592 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-00980ad0-3294-48ef-b164-b9d00a18d103 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:28.010203 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-00980ad0-3294-48ef-b164-b9d00a18d103 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:28.017909 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-00980ad0-3294-48ef-b164-b9d00a18d103 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068" status: 200 len: 1573 microversion: 2.1 time: 0.172210 Aug 01 14:30:28.018493 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 546/1080] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:27 2022] GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068 => generated 1573 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:30:28.871793 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c09e7aa7-75fe-48a9-be65-f1000d1b67d1 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:28.872403 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c09e7aa7-75fe-48a9-be65-f1000d1b67d1 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:28.874377 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=6 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:28.880804 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c09e7aa7-75fe-48a9-be65-f1000d1b67d1 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:28.881245 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c09e7aa7-75fe-48a9-be65-f1000d1b67d1 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:28.882018 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c09e7aa7-75fe-48a9-be65-f1000d1b67d1 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:28.882449 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c09e7aa7-75fe-48a9-be65-f1000d1b67d1 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:29.018075 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c09e7aa7-75fe-48a9-be65-f1000d1b67d1 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:29.026063 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c09e7aa7-75fe-48a9-be65-f1000d1b67d1 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03" status: 200 len: 1362 microversion: 2.1 time: 0.158144 Aug 01 14:30:29.026641 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 535/1081] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:28 2022] GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:29.040145 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-7dcddc38-818a-4f1a-b053-790a6cfbb932 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:29.041024 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-7dcddc38-818a-4f1a-b053-790a6cfbb932 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: fb882cc8-dad4-4898-9d57-ba546c8b1068] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:29.043229 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=2 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:29.044025 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=6 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:29.051374 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7dcddc38-818a-4f1a-b053-790a6cfbb932 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:29.051841 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7dcddc38-818a-4f1a-b053-790a6cfbb932 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:29.052613 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7dcddc38-818a-4f1a-b053-790a6cfbb932 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:29.053036 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-7dcddc38-818a-4f1a-b053-790a6cfbb932 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:29.190375 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-7dcddc38-818a-4f1a-b053-790a6cfbb932 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:29.198371 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-7dcddc38-818a-4f1a-b053-790a6cfbb932 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068" status: 200 len: 1573 microversion: 2.1 time: 0.162238 Aug 01 14:30:29.198946 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 547/1082] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:29 2022] GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068 => generated 1573 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:30.048037 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-37216de8-fb2e-4bf7-8e49-96b7981791a0 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:30.048654 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-37216de8-fb2e-4bf7-8e49-96b7981791a0 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:30.055901 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-37216de8-fb2e-4bf7-8e49-96b7981791a0 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:30.056384 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-37216de8-fb2e-4bf7-8e49-96b7981791a0 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:30.057154 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-37216de8-fb2e-4bf7-8e49-96b7981791a0 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:30.057596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-37216de8-fb2e-4bf7-8e49-96b7981791a0 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:30.212432 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-37216de8-fb2e-4bf7-8e49-96b7981791a0 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:30.221789 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-37216de8-fb2e-4bf7-8e49-96b7981791a0 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03" status: 200 len: 1547 microversion: 2.1 time: 0.177991 Aug 01 14:30:30.222590 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 536/1083] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:30 2022] GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03 => generated 1547 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:30.229666 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-572a3f38-8cc5-494d-8b78-6c0b128d00f4 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:30.230278 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-572a3f38-8cc5-494d-8b78-6c0b128d00f4 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: fb882cc8-dad4-4898-9d57-ba546c8b1068] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:30.238098 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-572a3f38-8cc5-494d-8b78-6c0b128d00f4 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:30.238545 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-572a3f38-8cc5-494d-8b78-6c0b128d00f4 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:30.239309 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-572a3f38-8cc5-494d-8b78-6c0b128d00f4 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:30.239759 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-572a3f38-8cc5-494d-8b78-6c0b128d00f4 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:30.243233 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3bc25b12-f5ac-4fa0-a852-90e4c9d41657 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:30.243736 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3bc25b12-f5ac-4fa0-a852-90e4c9d41657 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:30.249917 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3bc25b12-f5ac-4fa0-a852-90e4c9d41657 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:30.250360 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3bc25b12-f5ac-4fa0-a852-90e4c9d41657 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:30.251718 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3bc25b12-f5ac-4fa0-a852-90e4c9d41657 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:30.252164 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3bc25b12-f5ac-4fa0-a852-90e4c9d41657 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:30.352607 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3bc25b12-f5ac-4fa0-a852-90e4c9d41657 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113158 Aug 01 14:30:30.353231 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 537/1084] 10.222.0.17 () {58 vars in 1275 bytes} [Mon Aug 1 14:30:30 2022] GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:30:30.482112 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-572a3f38-8cc5-494d-8b78-6c0b128d00f4 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:30.491174 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-572a3f38-8cc5-494d-8b78-6c0b128d00f4 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068" status: 200 len: 1573 microversion: 2.1 time: 0.275020 Aug 01 14:30:30.493545 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 548/1085] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:30 2022] GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068 => generated 1573 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:31.438691 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-1356320e-8c5d-4e35-8246-8a4d53467a91 req-1db545b5-9e57-4d42-8f2a-150a8408c9bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09455b95-58be-4c8c-b8f4-5969ed769c03", "tag": "dc0ba090-64fe-4fe6-ab75-2767eeb3bdd9"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:30:31.448985 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-1356320e-8c5d-4e35-8246-8a4d53467a91 req-1db545b5-9e57-4d42-8f2a-150a8408c9bd service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:31.449554 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-1356320e-8c5d-4e35-8246-8a4d53467a91 req-1db545b5-9e57-4d42-8f2a-150a8408c9bd service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:31.464766 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-1356320e-8c5d-4e35-8246-8a4d53467a91 req-1db545b5-9e57-4d42-8f2a-150a8408c9bd service nova] Creating event network-changed:dc0ba090-64fe-4fe6-ab75-2767eeb3bdd9 for instance 09455b95-58be-4c8c-b8f4-5969ed769c03 on hv-cinder-84599 Aug 01 14:30:31.470498 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-1356320e-8c5d-4e35-8246-8a4d53467a91 req-1db545b5-9e57-4d42-8f2a-150a8408c9bd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039264 Aug 01 14:30:31.470985 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 538/1086] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:30:31.521403 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-3c83008f-edc6-4a9b-83ae-ef32c27e3266 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:31.523208 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-3c83008f-edc6-4a9b-83ae-ef32c27e3266 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: fb882cc8-dad4-4898-9d57-ba546c8b1068] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:31.537609 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3c83008f-edc6-4a9b-83ae-ef32c27e3266 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:31.538066 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3c83008f-edc6-4a9b-83ae-ef32c27e3266 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:31.538870 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3c83008f-edc6-4a9b-83ae-ef32c27e3266 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:31.539690 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-3c83008f-edc6-4a9b-83ae-ef32c27e3266 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:31.647423 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-3c83008f-edc6-4a9b-83ae-ef32c27e3266 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:31.661075 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-3c83008f-edc6-4a9b-83ae-ef32c27e3266 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068" status: 200 len: 1506 microversion: 2.1 time: 0.150397 Aug 01 14:30:31.662430 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 549/1087] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:31 2022] GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:31.780376 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-4a08fb4d-1b80-409f-befa-32ea9aae0b49 req-ba0918a3-5a98-4710-a0eb-ae4230a112f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb882cc8-dad4-4898-9d57-ba546c8b1068", "name": "network-vif-deleted", "tag": "bd4c8486-8b99-459f-b0ee-44c166b81fff"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:30:31.810037 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-4a08fb4d-1b80-409f-befa-32ea9aae0b49 req-ba0918a3-5a98-4710-a0eb-ae4230a112f2 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:31.812350 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-4a08fb4d-1b80-409f-befa-32ea9aae0b49 req-ba0918a3-5a98-4710-a0eb-ae4230a112f2 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:31.847990 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-4a08fb4d-1b80-409f-befa-32ea9aae0b49 req-ba0918a3-5a98-4710-a0eb-ae4230a112f2 service nova] Creating event network-vif-deleted:bd4c8486-8b99-459f-b0ee-44c166b81fff for instance fb882cc8-dad4-4898-9d57-ba546c8b1068 on hv-cinder-84599 Aug 01 14:30:31.862122 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-4a08fb4d-1b80-409f-befa-32ea9aae0b49 req-ba0918a3-5a98-4710-a0eb-ae4230a112f2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085936 Aug 01 14:30:31.864599 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 539/1088] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:30:32.691487 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5f354940-e995-4561-82a2-c941e9f24c95 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:32.693230 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-5f354940-e995-4561-82a2-c941e9f24c95 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: fb882cc8-dad4-4898-9d57-ba546c8b1068] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:32.701933 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5f354940-e995-4561-82a2-c941e9f24c95 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:32.708520 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5f354940-e995-4561-82a2-c941e9f24c95 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:32.710773 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5f354940-e995-4561-82a2-c941e9f24c95 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:32.711224 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-5f354940-e995-4561-82a2-c941e9f24c95 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:32.728661 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-5f354940-e995-4561-82a2-c941e9f24c95 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] HTTP exception thrown: Instance fb882cc8-dad4-4898-9d57-ba546c8b1068 could not be found. Aug 01 14:30:32.730310 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5f354940-e995-4561-82a2-c941e9f24c95 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Request method failure captured: Aug 01 14:30:32.730310 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068 HTTP/1.1 Aug 01 14:30:32.730310 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept: application/json Aug 01 14:30:32.730310 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Aug 01 14:30:32.730310 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Connection: close Aug 01 14:30:32.730310 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Length: 0 Aug 01 14:30:32.730310 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Type: application/json Aug 01 14:30:32.730310 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Host: 10.222.0.17 Aug 01 14:30:32.730310 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Aug 01 14:30:32.730310 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.10 Aug 01 14:30:32.730310 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABi5-LfRmx8f2rN3g_ovRrxbb2lopd0_OZEMNfRL90IttDnr3EeG6rXqYZXuQY7cKcG0JZ9f5tz9EPxGSf3VHC_YPM3ZtfQlzh4g71cOhNH4rHxlpD5LC2A5orXWMD6V-pJ4rV2P1grfTqjxmX7Ynj3hW65Q9kHcjgdGxM7oGexZxqG13g Aug 01 14:30:32.730310 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Aug 01 14:30:32.730310 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Aug 01 14:30:32.730310 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Aug 01 14:30:32.730310 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Aug 01 14:30:32.730310 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Aug 01 14:30:32.730310 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Aug 01 14:30:32.730310 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Id: 47e500c5985743a2a5abfb99c0f42ab7 Aug 01 14:30:32.730310 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-TestVolumeBootPattern-1884404681 Aug 01 14:30:32.730310 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Role: reader,member Aug 01 14:30:32.730310 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Roles: reader,member Aug 01 14:30:32.731710 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/47e500c5985743a2a5abfb99c0f42ab7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/47e500c5985743a2a5abfb99c0f42ab7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/47e500c5985743a2a5abfb99c0f42ab7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_47e500c5985743a2a5abfb99c0f42ab7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:30:32.731710 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-TestVolumeBootPattern-1884404681 Aug 01 14:30:32.731710 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 47e500c5985743a2a5abfb99c0f42ab7 Aug 01 14:30:32.731710 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-TestVolumeBootPattern-1884404681 Aug 01 14:30:32.731710 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User: tempest-TestVolumeBootPattern-1884404681-project Aug 01 14:30:32.731710 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Aug 01 14:30:32.731710 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Aug 01 14:30:32.731710 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Id: 540bec8413b144889a07e9d9458b298e Aug 01 14:30:32.731710 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-TestVolumeBootPattern-1884404681-project Aug 01 14:30:32.731710 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: method: > Aug 01 14:30:32.731710 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: exception: Instance fb882cc8-dad4-4898-9d57-ba546c8b1068 could not be found. Aug 01 14:30:32.731710 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: action_args: {'id': 'fb882cc8-dad4-4898-9d57-ba546c8b1068'} Aug 01 14:30:32.732515 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:30:32.732515 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:30:32.732515 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:30:32.732515 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:30:32.732515 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:30:32.732515 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:30:32.732515 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:30:32.732515 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:30:32.732515 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:30:32.732515 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:30:32.732515 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb882cc8-dad4-4898-9d57-ba546c8b1068 could not be found. Aug 01 14:30:32.732515 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:30:32.732515 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:30:32.732515 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:30:32.732515 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:30:32.732515 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:30:32.732515 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:30:32.732515 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:30:32.732515 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:30:32.732515 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:30:32.733735 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:30:32.733735 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:30:32.733735 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:30:32.733735 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:30:32.733735 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:30:32.733735 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:30:32.733735 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:30:32.733735 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb882cc8-dad4-4898-9d57-ba546c8b1068 could not be found. Aug 01 14:30:32.733735 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:30:32.733735 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:30:32.733735 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:30:32.733735 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:30:32.733735 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:30:32.733735 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:30:32.733735 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:30:32.733735 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:30:32.733735 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb882cc8-dad4-4898-9d57-ba546c8b1068 could not be found. Aug 01 14:30:32.733735 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:30:32.736891 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-5f354940-e995-4561-82a2-c941e9f24c95 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Returning 404 to user: Instance fb882cc8-dad4-4898-9d57-ba546c8b1068 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:30:32.737940 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-5f354940-e995-4561-82a2-c941e9f24c95 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068" status: 404 len: 111 microversion: 2.1 time: 0.052760 Aug 01 14:30:32.738843 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 550/1089] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:32 2022] GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:30:32.867868 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-4f869ece-b4ba-481c-a42c-d17832cbde32 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-202395649", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-89656764", "security_groups": [{"name": "tempest-secgroup-smoke-107218195"}], "block_device_mapping_v2": [{"uuid": "af5eb09d-ad9d-4687-9a26-8d33a3e9242f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "be2b1497-5181-491f-9b7c-a16c7782ef71"}]}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:30:33.039033 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.network.neutron [None req-4f869ece-b4ba-481c-a42c-d17832cbde32 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] validate_networks() for [('be2b1497-5181-491f-9b7c-a16c7782ef71', None, None, None, None, None)] {{(pid=118133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:30:33.510410 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-4f869ece-b4ba-481c-a42c-d17832cbde32 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Flavor limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:30:33.510832 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-4f869ece-b4ba-481c-a42c-d17832cbde32 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Image limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:30:33.511299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-4f869ece-b4ba-481c-a42c-d17832cbde32 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Flavor pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:30:33.511748 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-4f869ece-b4ba-481c-a42c-d17832cbde32 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Image pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:30:33.512169 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-4f869ece-b4ba-481c-a42c-d17832cbde32 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:30:33.528221 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4f869ece-b4ba-481c-a42c-d17832cbde32 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:33.528221 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4f869ece-b4ba-481c-a42c-d17832cbde32 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:33.528221 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4f869ece-b4ba-481c-a42c-d17832cbde32 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:33.528221 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4f869ece-b4ba-481c-a42c-d17832cbde32 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:33.554395 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-4f869ece-b4ba-481c-a42c-d17832cbde32 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Getting quotas for project 47e500c5985743a2a5abfb99c0f42ab7. Resources: {'instances', 'cores', 'ram'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:30:33.562063 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-4f869ece-b4ba-481c-a42c-d17832cbde32 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Getting quotas for user 540bec8413b144889a07e9d9458b298e and project 47e500c5985743a2a5abfb99c0f42ab7. Resources: {'instances', 'cores', 'ram'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:30:33.628123 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-4f869ece-b4ba-481c-a42c-d17832cbde32 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Going to run 1 instances... {{(pid=118133) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:30:33.630297 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-4f869ece-b4ba-481c-a42c-d17832cbde32 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 24df2492-1b6b-4650-a0d1-1015b1dbe6b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='af5eb09d-ad9d-4687-9a26-8d33a3e9242f',volume_size=None,volume_type=None)] {{(pid=118133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:30:33.802089 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-4f869ece-b4ba-481c-a42c-d17832cbde32 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.938356 Aug 01 14:30:33.803050 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 540/1090] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Aug 1 14:30:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:30:33.815676 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9c1b5409-18de-496e-a92a-165efaac819e tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:33.816488 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9c1b5409-18de-496e-a92a-165efaac819e tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 24df2492-1b6b-4650-a0d1-1015b1dbe6b3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:33.886858 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-9c1b5409-18de-496e-a92a-165efaac819e tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:33.894751 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9c1b5409-18de-496e-a92a-165efaac819e tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3" status: 200 len: 1092 microversion: 2.1 time: 0.084380 Aug 01 14:30:33.895954 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 551/1091] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:33 2022] GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3 => generated 1092 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:34.919505 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e7d8d2f5-f5f2-42eb-805f-0144005e4116 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:34.920334 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e7d8d2f5-f5f2-42eb-805f-0144005e4116 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 24df2492-1b6b-4650-a0d1-1015b1dbe6b3] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:34.930905 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e7d8d2f5-f5f2-42eb-805f-0144005e4116 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:34.931594 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e7d8d2f5-f5f2-42eb-805f-0144005e4116 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:34.932210 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e7d8d2f5-f5f2-42eb-805f-0144005e4116 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:34.932658 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e7d8d2f5-f5f2-42eb-805f-0144005e4116 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:35.020219 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e7d8d2f5-f5f2-42eb-805f-0144005e4116 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:35.034260 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e7d8d2f5-f5f2-42eb-805f-0144005e4116 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3" status: 200 len: 1190 microversion: 2.1 time: 0.119790 Aug 01 14:30:35.035560 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 541/1092] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:34 2022] GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3 => generated 1190 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:36.059810 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-35c2bd6f-1cdf-443e-bd5b-938993942f47 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:36.060648 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-35c2bd6f-1cdf-443e-bd5b-938993942f47 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 24df2492-1b6b-4650-a0d1-1015b1dbe6b3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:36.071075 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-35c2bd6f-1cdf-443e-bd5b-938993942f47 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:36.071939 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-35c2bd6f-1cdf-443e-bd5b-938993942f47 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:36.075310 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-35c2bd6f-1cdf-443e-bd5b-938993942f47 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:36.076371 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-35c2bd6f-1cdf-443e-bd5b-938993942f47 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:36.334283 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-35c2bd6f-1cdf-443e-bd5b-938993942f47 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:36.346115 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-35c2bd6f-1cdf-443e-bd5b-938993942f47 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3" status: 200 len: 1275 microversion: 2.1 time: 0.292437 Aug 01 14:30:36.346892 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 552/1093] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:36 2022] GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3 => generated 1275 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:36.908792 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-d3a9f156-1477-4382-a2ee-b9889dd356c2 req-e9269123-9633-4fda-8294-37cd57605b94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24df2492-1b6b-4650-a0d1-1015b1dbe6b3", "tag": "05d47566-3728-458d-8ceb-0d05488c35f6"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:30:36.920680 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-d3a9f156-1477-4382-a2ee-b9889dd356c2 req-e9269123-9633-4fda-8294-37cd57605b94 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:36.921403 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-d3a9f156-1477-4382-a2ee-b9889dd356c2 req-e9269123-9633-4fda-8294-37cd57605b94 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:36.936373 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-d3a9f156-1477-4382-a2ee-b9889dd356c2 req-e9269123-9633-4fda-8294-37cd57605b94 service nova] Creating event network-changed:05d47566-3728-458d-8ceb-0d05488c35f6 for instance 24df2492-1b6b-4650-a0d1-1015b1dbe6b3 on hv-cinder-84599 Aug 01 14:30:36.942241 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-d3a9f156-1477-4382-a2ee-b9889dd356c2 req-e9269123-9633-4fda-8294-37cd57605b94 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037802 Aug 01 14:30:36.943902 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 542/1094] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:30:37.367876 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-587850d5-09f0-43f2-bd75-5fab8a377ce9 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:37.368666 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-587850d5-09f0-43f2-bd75-5fab8a377ce9 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 24df2492-1b6b-4650-a0d1-1015b1dbe6b3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:37.377294 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-587850d5-09f0-43f2-bd75-5fab8a377ce9 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:37.378012 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-587850d5-09f0-43f2-bd75-5fab8a377ce9 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:37.378825 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-587850d5-09f0-43f2-bd75-5fab8a377ce9 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:37.380960 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-587850d5-09f0-43f2-bd75-5fab8a377ce9 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:37.386890 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:37.672281 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-587850d5-09f0-43f2-bd75-5fab8a377ce9 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:37.683062 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-587850d5-09f0-43f2-bd75-5fab8a377ce9 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3" status: 200 len: 1263 microversion: 2.1 time: 0.319416 Aug 01 14:30:37.684825 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 553/1095] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:37 2022] GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3 => generated 1263 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:38.710351 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b68aea74-b16c-4987-b337-31fa4804f2e8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:38.711047 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b68aea74-b16c-4987-b337-31fa4804f2e8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 24df2492-1b6b-4650-a0d1-1015b1dbe6b3] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:38.717890 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b68aea74-b16c-4987-b337-31fa4804f2e8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:38.718338 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b68aea74-b16c-4987-b337-31fa4804f2e8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:38.719346 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b68aea74-b16c-4987-b337-31fa4804f2e8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:38.719818 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b68aea74-b16c-4987-b337-31fa4804f2e8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:38.883278 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b68aea74-b16c-4987-b337-31fa4804f2e8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:38.885733 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:38.893551 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b68aea74-b16c-4987-b337-31fa4804f2e8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3" status: 200 len: 1263 microversion: 2.1 time: 0.187873 Aug 01 14:30:38.894155 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 543/1096] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:38 2022] GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3 => generated 1263 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:39.921228 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-00e1cae6-ebc3-4ee0-b8c5-f9139c1036fd tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:39.921797 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-00e1cae6-ebc3-4ee0-b8c5-f9139c1036fd tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 24df2492-1b6b-4650-a0d1-1015b1dbe6b3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:39.924408 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:39.932162 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-00e1cae6-ebc3-4ee0-b8c5-f9139c1036fd tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:39.932621 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-00e1cae6-ebc3-4ee0-b8c5-f9139c1036fd tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:39.933387 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-00e1cae6-ebc3-4ee0-b8c5-f9139c1036fd tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:39.933829 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-00e1cae6-ebc3-4ee0-b8c5-f9139c1036fd tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:40.092602 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-00e1cae6-ebc3-4ee0-b8c5-f9139c1036fd tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:40.101156 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-00e1cae6-ebc3-4ee0-b8c5-f9139c1036fd tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3" status: 200 len: 1263 microversion: 2.1 time: 0.183999 Aug 01 14:30:40.101747 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 554/1097] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:39 2022] GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3 => generated 1263 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:30:41.124918 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b198479f-0640-400b-b4df-3d32423905f7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:41.128390 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b198479f-0640-400b-b4df-3d32423905f7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 24df2492-1b6b-4650-a0d1-1015b1dbe6b3] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:41.133246 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:41.138060 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b198479f-0640-400b-b4df-3d32423905f7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:41.138505 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b198479f-0640-400b-b4df-3d32423905f7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:41.139294 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b198479f-0640-400b-b4df-3d32423905f7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:41.140820 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b198479f-0640-400b-b4df-3d32423905f7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:41.327154 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b198479f-0640-400b-b4df-3d32423905f7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:41.336986 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b198479f-0640-400b-b4df-3d32423905f7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3" status: 200 len: 1263 microversion: 2.1 time: 0.218363 Aug 01 14:30:41.337593 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 544/1098] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:41 2022] GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3 => generated 1263 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:42.368866 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8ca1f818-4f03-4bb3-9374-7461f4c8ded3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:42.369479 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-8ca1f818-4f03-4bb3-9374-7461f4c8ded3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 24df2492-1b6b-4650-a0d1-1015b1dbe6b3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:42.376269 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8ca1f818-4f03-4bb3-9374-7461f4c8ded3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:42.376719 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8ca1f818-4f03-4bb3-9374-7461f4c8ded3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:42.377480 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8ca1f818-4f03-4bb3-9374-7461f4c8ded3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:42.377913 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-8ca1f818-4f03-4bb3-9374-7461f4c8ded3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:42.511741 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-8ca1f818-4f03-4bb3-9374-7461f4c8ded3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:42.519360 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8ca1f818-4f03-4bb3-9374-7461f4c8ded3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3" status: 200 len: 1263 microversion: 2.1 time: 0.154361 Aug 01 14:30:42.525049 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 555/1099] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:42 2022] GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:43.540785 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c8f81ea7-8868-4d10-a185-71e78a403d80 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:43.541387 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c8f81ea7-8868-4d10-a185-71e78a403d80 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 24df2492-1b6b-4650-a0d1-1015b1dbe6b3] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:43.543835 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:43.550088 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c8f81ea7-8868-4d10-a185-71e78a403d80 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:43.550534 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c8f81ea7-8868-4d10-a185-71e78a403d80 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:43.551346 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c8f81ea7-8868-4d10-a185-71e78a403d80 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:43.551806 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c8f81ea7-8868-4d10-a185-71e78a403d80 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:43.573698 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=6 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:43.699827 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c8f81ea7-8868-4d10-a185-71e78a403d80 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:43.707784 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c8f81ea7-8868-4d10-a185-71e78a403d80 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3" status: 200 len: 1263 microversion: 2.1 time: 0.170900 Aug 01 14:30:43.708372 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 545/1100] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:43 2022] GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3 => generated 1263 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:44.729550 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-dce69c7d-cc19-41cb-8573-d459a9128738 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:44.730161 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-dce69c7d-cc19-41cb-8573-d459a9128738 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 24df2492-1b6b-4650-a0d1-1015b1dbe6b3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:44.732526 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=2 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:44.738779 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dce69c7d-cc19-41cb-8573-d459a9128738 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:44.739232 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dce69c7d-cc19-41cb-8573-d459a9128738 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:44.740040 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dce69c7d-cc19-41cb-8573-d459a9128738 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:44.740477 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-dce69c7d-cc19-41cb-8573-d459a9128738 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:44.876220 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-dce69c7d-cc19-41cb-8573-d459a9128738 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:44.884175 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-dce69c7d-cc19-41cb-8573-d459a9128738 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3" status: 200 len: 1263 microversion: 2.1 time: 0.158740 Aug 01 14:30:44.884759 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 556/1101] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:44 2022] GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3 => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:45.905650 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-35c0b0c6-a8ef-47f1-a2c1-62aa033b5351 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:45.906274 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-35c0b0c6-a8ef-47f1-a2c1-62aa033b5351 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 24df2492-1b6b-4650-a0d1-1015b1dbe6b3] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:45.913526 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-35c0b0c6-a8ef-47f1-a2c1-62aa033b5351 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:45.913983 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-35c0b0c6-a8ef-47f1-a2c1-62aa033b5351 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:45.914800 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-35c0b0c6-a8ef-47f1-a2c1-62aa033b5351 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:45.915185 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-35c0b0c6-a8ef-47f1-a2c1-62aa033b5351 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:46.049150 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-35c0b0c6-a8ef-47f1-a2c1-62aa033b5351 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:46.056713 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-35c0b0c6-a8ef-47f1-a2c1-62aa033b5351 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3" status: 200 len: 1263 microversion: 2.1 time: 0.154950 Aug 01 14:30:46.057305 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 546/1102] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:45 2022] GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:47.077800 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-21813bd1-294a-468a-95ae-b67715b7be71 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:47.078398 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-21813bd1-294a-468a-95ae-b67715b7be71 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 24df2492-1b6b-4650-a0d1-1015b1dbe6b3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:47.086037 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-21813bd1-294a-468a-95ae-b67715b7be71 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:47.086490 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-21813bd1-294a-468a-95ae-b67715b7be71 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:47.087334 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-21813bd1-294a-468a-95ae-b67715b7be71 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:47.087811 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-21813bd1-294a-468a-95ae-b67715b7be71 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:47.225840 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-21813bd1-294a-468a-95ae-b67715b7be71 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:47.234011 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-21813bd1-294a-468a-95ae-b67715b7be71 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3" status: 200 len: 1263 microversion: 2.1 time: 0.160162 Aug 01 14:30:47.234576 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 557/1103] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:47 2022] GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:48.255137 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3e693f35-f885-4920-87b6-1d79d71a8a21 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:48.255846 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3e693f35-f885-4920-87b6-1d79d71a8a21 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 24df2492-1b6b-4650-a0d1-1015b1dbe6b3] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:48.263011 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e693f35-f885-4920-87b6-1d79d71a8a21 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:48.263470 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e693f35-f885-4920-87b6-1d79d71a8a21 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:48.264244 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e693f35-f885-4920-87b6-1d79d71a8a21 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:48.264671 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e693f35-f885-4920-87b6-1d79d71a8a21 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:48.398002 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3e693f35-f885-4920-87b6-1d79d71a8a21 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:48.405579 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3e693f35-f885-4920-87b6-1d79d71a8a21 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3" status: 200 len: 1263 microversion: 2.1 time: 0.154386 Aug 01 14:30:48.406150 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 547/1104] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:48 2022] GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:49.024854 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-6e9d111f-e460-448b-8273-9c4a37d90a4b req-4e08608a-5cde-4470-958c-4502ebc76b30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24df2492-1b6b-4650-a0d1-1015b1dbe6b3", "name": "network-vif-plugged", "status": "completed", "tag": "05d47566-3728-458d-8ceb-0d05488c35f6"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:30:49.036105 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-6e9d111f-e460-448b-8273-9c4a37d90a4b req-4e08608a-5cde-4470-958c-4502ebc76b30 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:49.036579 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-6e9d111f-e460-448b-8273-9c4a37d90a4b req-4e08608a-5cde-4470-958c-4502ebc76b30 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:49.048878 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-6e9d111f-e460-448b-8273-9c4a37d90a4b req-4e08608a-5cde-4470-958c-4502ebc76b30 service nova] Creating event network-vif-plugged:05d47566-3728-458d-8ceb-0d05488c35f6 for instance 24df2492-1b6b-4650-a0d1-1015b1dbe6b3 on hv-cinder-84599 Aug 01 14:30:49.053969 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-6e9d111f-e460-448b-8273-9c4a37d90a4b req-4e08608a-5cde-4470-958c-4502ebc76b30 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032902 Aug 01 14:30:49.054762 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 558/1105] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:30:49.426657 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-1c5192f7-f28f-46b4-99af-8d34c29b3cb7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:49.427318 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1c5192f7-f28f-46b4-99af-8d34c29b3cb7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 24df2492-1b6b-4650-a0d1-1015b1dbe6b3] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:49.433897 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1c5192f7-f28f-46b4-99af-8d34c29b3cb7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:49.434356 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1c5192f7-f28f-46b4-99af-8d34c29b3cb7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:49.435118 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1c5192f7-f28f-46b4-99af-8d34c29b3cb7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:49.435589 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1c5192f7-f28f-46b4-99af-8d34c29b3cb7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:49.573091 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1c5192f7-f28f-46b4-99af-8d34c29b3cb7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:49.580636 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-1c5192f7-f28f-46b4-99af-8d34c29b3cb7 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3" status: 200 len: 1263 microversion: 2.1 time: 0.157798 Aug 01 14:30:49.581133 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 548/1106] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:49 2022] GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3 => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:50.601884 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ea260d9c-1c3b-4dce-8a98-2f35433f7efb tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:50.602870 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ea260d9c-1c3b-4dce-8a98-2f35433f7efb tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 24df2492-1b6b-4650-a0d1-1015b1dbe6b3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:50.609840 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ea260d9c-1c3b-4dce-8a98-2f35433f7efb tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:50.610278 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ea260d9c-1c3b-4dce-8a98-2f35433f7efb tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:50.611039 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ea260d9c-1c3b-4dce-8a98-2f35433f7efb tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:50.611483 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ea260d9c-1c3b-4dce-8a98-2f35433f7efb tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:50.743205 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ea260d9c-1c3b-4dce-8a98-2f35433f7efb tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:50.750642 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ea260d9c-1c3b-4dce-8a98-2f35433f7efb tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3" status: 200 len: 1263 microversion: 2.1 time: 0.153133 Aug 01 14:30:50.751757 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 559/1107] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:50 2022] GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:51.774205 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-feee68ee-a091-40ea-832d-73294840db71 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:51.774810 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-feee68ee-a091-40ea-832d-73294840db71 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 24df2492-1b6b-4650-a0d1-1015b1dbe6b3] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:51.781569 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-feee68ee-a091-40ea-832d-73294840db71 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:51.782027 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-feee68ee-a091-40ea-832d-73294840db71 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:51.782800 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-feee68ee-a091-40ea-832d-73294840db71 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:51.783246 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-feee68ee-a091-40ea-832d-73294840db71 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:51.914220 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-feee68ee-a091-40ea-832d-73294840db71 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:51.921753 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-feee68ee-a091-40ea-832d-73294840db71 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3" status: 200 len: 1450 microversion: 2.1 time: 0.153750 Aug 01 14:30:51.922320 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 549/1108] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:51 2022] GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:51.942361 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e435981f-9f3a-4e38-a9bb-542c8d53bb0e tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:51.942966 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e435981f-9f3a-4e38-a9bb-542c8d53bb0e tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 24df2492-1b6b-4650-a0d1-1015b1dbe6b3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:51.949454 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e435981f-9f3a-4e38-a9bb-542c8d53bb0e tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:51.949902 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e435981f-9f3a-4e38-a9bb-542c8d53bb0e tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:51.950658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e435981f-9f3a-4e38-a9bb-542c8d53bb0e tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:51.951089 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e435981f-9f3a-4e38-a9bb-542c8d53bb0e tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:52.088028 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e435981f-9f3a-4e38-a9bb-542c8d53bb0e tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:52.099496 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e435981f-9f3a-4e38-a9bb-542c8d53bb0e tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3" status: 200 len: 1450 microversion: 2.1 time: 0.161135 Aug 01 14:30:52.100163 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 560/1109] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:51 2022] GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:54.084077 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-5d47d894-45a4-4796-a818-96475fc1427e req-1e6dd2ce-2915-45d3-afba-5511063a5a5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24df2492-1b6b-4650-a0d1-1015b1dbe6b3", "tag": "05d47566-3728-458d-8ceb-0d05488c35f6"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:30:54.094221 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-5d47d894-45a4-4796-a818-96475fc1427e req-1e6dd2ce-2915-45d3-afba-5511063a5a5b service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:54.094624 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-5d47d894-45a4-4796-a818-96475fc1427e req-1e6dd2ce-2915-45d3-afba-5511063a5a5b service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:54.106689 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-5d47d894-45a4-4796-a818-96475fc1427e req-1e6dd2ce-2915-45d3-afba-5511063a5a5b service nova] Creating event network-changed:05d47566-3728-458d-8ceb-0d05488c35f6 for instance 24df2492-1b6b-4650-a0d1-1015b1dbe6b3 on hv-cinder-84599 Aug 01 14:30:54.112377 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-5d47d894-45a4-4796-a818-96475fc1427e req-1e6dd2ce-2915-45d3-afba-5511063a5a5b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102983 Aug 01 14:30:54.113451 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 550/1110] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:30:56.353265 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0b8e7eb0-dad2-4d94-8fce-f225d7597b7a tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:30:56.353832 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0b8e7eb0-dad2-4d94-8fce-f225d7597b7a tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:56.360882 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0b8e7eb0-dad2-4d94-8fce-f225d7597b7a tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:56.361318 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0b8e7eb0-dad2-4d94-8fce-f225d7597b7a tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:56.362105 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0b8e7eb0-dad2-4d94-8fce-f225d7597b7a tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:56.362534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0b8e7eb0-dad2-4d94-8fce-f225d7597b7a tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:56.388496 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-0b8e7eb0-dad2-4d94-8fce-f225d7597b7a tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lazy-loading 'flavor' on Instance uuid 3e51815a-0d9e-494f-8960-a75433080b70 {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:30:56.463317 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0b8e7eb0-dad2-4d94-8fce-f225d7597b7a tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "POST /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70/action" status: 202 len: 0 microversion: 2.1 time: 0.114086 Aug 01 14:30:56.464024 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 561/1111] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Aug 1 14:30:56 2022] POST /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:30:56.473859 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-bda7db3a-51b1-4e92-bf37-5173f6833bfa tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:56.474562 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-bda7db3a-51b1-4e92-bf37-5173f6833bfa tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:56.482352 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bda7db3a-51b1-4e92-bf37-5173f6833bfa tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:56.482814 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bda7db3a-51b1-4e92-bf37-5173f6833bfa tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:56.483623 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bda7db3a-51b1-4e92-bf37-5173f6833bfa tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:56.484064 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bda7db3a-51b1-4e92-bf37-5173f6833bfa tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:56.622819 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-bda7db3a-51b1-4e92-bf37-5173f6833bfa tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:56.633148 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-bda7db3a-51b1-4e92-bf37-5173f6833bfa tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1569 microversion: 2.1 time: 0.164116 Aug 01 14:30:56.633741 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 551/1112] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:56 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:57.655288 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-167a3dbd-40e9-49ac-a22b-4320386d3ea9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:57.656111 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-167a3dbd-40e9-49ac-a22b-4320386d3ea9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:57.663266 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-167a3dbd-40e9-49ac-a22b-4320386d3ea9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:57.663738 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-167a3dbd-40e9-49ac-a22b-4320386d3ea9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:57.664520 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-167a3dbd-40e9-49ac-a22b-4320386d3ea9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:57.664952 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-167a3dbd-40e9-49ac-a22b-4320386d3ea9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:57.803439 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-167a3dbd-40e9-49ac-a22b-4320386d3ea9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:57.811032 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-167a3dbd-40e9-49ac-a22b-4320386d3ea9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1569 microversion: 2.1 time: 0.160545 Aug 01 14:30:57.811631 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 562/1113] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:57 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:58.832639 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-890a9025-745e-4ae9-8ddc-63be5cc0d328 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:58.833250 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-890a9025-745e-4ae9-8ddc-63be5cc0d328 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:58.840201 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-890a9025-745e-4ae9-8ddc-63be5cc0d328 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:58.840654 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-890a9025-745e-4ae9-8ddc-63be5cc0d328 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:58.841475 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-890a9025-745e-4ae9-8ddc-63be5cc0d328 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:58.841913 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-890a9025-745e-4ae9-8ddc-63be5cc0d328 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:58.980685 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-890a9025-745e-4ae9-8ddc-63be5cc0d328 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:58.989063 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-890a9025-745e-4ae9-8ddc-63be5cc0d328 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1569 microversion: 2.1 time: 0.160607 Aug 01 14:30:58.989588 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 552/1114] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:58 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:00.010029 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d7b284c9-e52d-453f-80f2-75c68cdca1c8 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:00.010652 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d7b284c9-e52d-453f-80f2-75c68cdca1c8 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:00.017614 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d7b284c9-e52d-453f-80f2-75c68cdca1c8 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:00.018054 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d7b284c9-e52d-453f-80f2-75c68cdca1c8 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:00.018804 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d7b284c9-e52d-453f-80f2-75c68cdca1c8 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:00.019229 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d7b284c9-e52d-453f-80f2-75c68cdca1c8 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:00.150046 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d7b284c9-e52d-453f-80f2-75c68cdca1c8 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:00.158208 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d7b284c9-e52d-453f-80f2-75c68cdca1c8 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1569 microversion: 2.1 time: 0.152014 Aug 01 14:31:00.158766 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 563/1115] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:00 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:01.179254 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-47429ae6-5d0e-4c64-8da8-66b4d680017d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:01.179890 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-47429ae6-5d0e-4c64-8da8-66b4d680017d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:01.186517 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-47429ae6-5d0e-4c64-8da8-66b4d680017d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:01.186966 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-47429ae6-5d0e-4c64-8da8-66b4d680017d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:01.187756 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-47429ae6-5d0e-4c64-8da8-66b4d680017d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:01.188198 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-47429ae6-5d0e-4c64-8da8-66b4d680017d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:01.330309 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-47429ae6-5d0e-4c64-8da8-66b4d680017d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:01.337878 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-47429ae6-5d0e-4c64-8da8-66b4d680017d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1569 microversion: 2.1 time: 0.162506 Aug 01 14:31:01.338440 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 553/1116] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:01 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:02.359984 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-4b7a56a8-07d9-40a3-adbc-1bb6ee57f723 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:02.360730 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-4b7a56a8-07d9-40a3-adbc-1bb6ee57f723 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:02.367316 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4b7a56a8-07d9-40a3-adbc-1bb6ee57f723 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:02.367787 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4b7a56a8-07d9-40a3-adbc-1bb6ee57f723 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:02.368558 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4b7a56a8-07d9-40a3-adbc-1bb6ee57f723 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:02.368995 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-4b7a56a8-07d9-40a3-adbc-1bb6ee57f723 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:02.504219 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-4b7a56a8-07d9-40a3-adbc-1bb6ee57f723 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:02.511910 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-4b7a56a8-07d9-40a3-adbc-1bb6ee57f723 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1569 microversion: 2.1 time: 0.155910 Aug 01 14:31:02.512493 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 564/1117] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:02 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:03.536867 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-4288a8fa-f3b0-41a7-8cf7-8e0b9f68809d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:03.537537 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-4288a8fa-f3b0-41a7-8cf7-8e0b9f68809d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:03.544969 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4288a8fa-f3b0-41a7-8cf7-8e0b9f68809d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:03.545508 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4288a8fa-f3b0-41a7-8cf7-8e0b9f68809d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:03.546332 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4288a8fa-f3b0-41a7-8cf7-8e0b9f68809d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:03.546770 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4288a8fa-f3b0-41a7-8cf7-8e0b9f68809d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:03.688686 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4288a8fa-f3b0-41a7-8cf7-8e0b9f68809d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:03.697149 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-4288a8fa-f3b0-41a7-8cf7-8e0b9f68809d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1569 microversion: 2.1 time: 0.165436 Aug 01 14:31:03.697724 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 554/1118] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:03 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:04.718197 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ea67abfd-80ec-4568-a830-0ee4b82c7b73 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:04.718829 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ea67abfd-80ec-4568-a830-0ee4b82c7b73 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:04.725415 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ea67abfd-80ec-4568-a830-0ee4b82c7b73 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:04.725865 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ea67abfd-80ec-4568-a830-0ee4b82c7b73 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:04.726638 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ea67abfd-80ec-4568-a830-0ee4b82c7b73 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:04.727072 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ea67abfd-80ec-4568-a830-0ee4b82c7b73 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:04.861231 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-ea67abfd-80ec-4568-a830-0ee4b82c7b73 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:04.868818 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ea67abfd-80ec-4568-a830-0ee4b82c7b73 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1569 microversion: 2.1 time: 0.154466 Aug 01 14:31:04.869390 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 565/1119] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:04 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:05.890012 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c6d87571-01ec-4ff4-9450-eeec22eb9c3b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:05.890641 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c6d87571-01ec-4ff4-9450-eeec22eb9c3b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:05.897493 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c6d87571-01ec-4ff4-9450-eeec22eb9c3b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:05.898238 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c6d87571-01ec-4ff4-9450-eeec22eb9c3b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:05.899648 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c6d87571-01ec-4ff4-9450-eeec22eb9c3b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:05.900448 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c6d87571-01ec-4ff4-9450-eeec22eb9c3b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:06.046414 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c6d87571-01ec-4ff4-9450-eeec22eb9c3b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:06.057888 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c6d87571-01ec-4ff4-9450-eeec22eb9c3b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1569 microversion: 2.1 time: 0.171397 Aug 01 14:31:06.058490 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 555/1120] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:05 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:07.080112 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-62e1f627-30b3-411f-b61f-7cff81ed4bd9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:07.080758 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-62e1f627-30b3-411f-b61f-7cff81ed4bd9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:07.087658 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-62e1f627-30b3-411f-b61f-7cff81ed4bd9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:07.088113 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-62e1f627-30b3-411f-b61f-7cff81ed4bd9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:07.088893 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-62e1f627-30b3-411f-b61f-7cff81ed4bd9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:07.089326 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-62e1f627-30b3-411f-b61f-7cff81ed4bd9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:07.323627 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-62e1f627-30b3-411f-b61f-7cff81ed4bd9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:07.332249 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-62e1f627-30b3-411f-b61f-7cff81ed4bd9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1569 microversion: 2.1 time: 0.256510 Aug 01 14:31:07.333076 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 566/1121] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:07 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1569 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:31:07.671873 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0017e899-b6a9-4e36-8dc9-f1e8c04dd6c3 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:07.672417 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0017e899-b6a9-4e36-8dc9-f1e8c04dd6c3 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:07.680059 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0017e899-b6a9-4e36-8dc9-f1e8c04dd6c3 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:07.680503 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0017e899-b6a9-4e36-8dc9-f1e8c04dd6c3 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:07.681265 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0017e899-b6a9-4e36-8dc9-f1e8c04dd6c3 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:07.681693 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0017e899-b6a9-4e36-8dc9-f1e8c04dd6c3 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:07.710099 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0017e899-b6a9-4e36-8dc9-f1e8c04dd6c3 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03/ips" status: 200 len: 145 microversion: 2.1 time: 0.042420 Aug 01 14:31:07.711278 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 556/1122] 10.222.0.17 () {58 vars in 1248 bytes} [Mon Aug 1 14:31:07 2022] GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:31:08.353631 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-193a5de1-42b2-45e4-ad1f-d22afdbcaf4a tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:08.354250 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-193a5de1-42b2-45e4-ad1f-d22afdbcaf4a tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:08.361339 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-193a5de1-42b2-45e4-ad1f-d22afdbcaf4a tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:08.361776 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-193a5de1-42b2-45e4-ad1f-d22afdbcaf4a tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:08.362534 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-193a5de1-42b2-45e4-ad1f-d22afdbcaf4a tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:08.362958 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-193a5de1-42b2-45e4-ad1f-d22afdbcaf4a tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:08.365759 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:08.502284 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-193a5de1-42b2-45e4-ad1f-d22afdbcaf4a tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:08.511063 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-193a5de1-42b2-45e4-ad1f-d22afdbcaf4a tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1569 microversion: 2.1 time: 0.161426 Aug 01 14:31:08.511680 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 567/1123] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:08 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:09.054201 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ce3796b6-1992-4b34-b57f-3c7b9031c533 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c689619-ff12-4af6-859a-827c7cb247e4"}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:31:09.056555 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ce3796b6-1992-4b34-b57f-3c7b9031c533 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:09.063071 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ce3796b6-1992-4b34-b57f-3c7b9031c533 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:09.064123 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ce3796b6-1992-4b34-b57f-3c7b9031c533 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:09.064902 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ce3796b6-1992-4b34-b57f-3c7b9031c533 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:09.065331 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ce3796b6-1992-4b34-b57f-3c7b9031c533 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:09.356151 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ce3796b6-1992-4b34-b57f-3c7b9031c533 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "POST /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305447 Aug 01 14:31:09.357354 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 557/1124] 10.222.0.17 () {60 vars in 1323 bytes} [Mon Aug 1 14:31:09 2022] POST /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:31:09.533478 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c2e58008-ec47-4cc6-ba20-0376f5f270fd tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:09.534107 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c2e58008-ec47-4cc6-ba20-0376f5f270fd tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:09.540866 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c2e58008-ec47-4cc6-ba20-0376f5f270fd tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:09.541952 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c2e58008-ec47-4cc6-ba20-0376f5f270fd tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:09.542126 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c2e58008-ec47-4cc6-ba20-0376f5f270fd tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:09.542504 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c2e58008-ec47-4cc6-ba20-0376f5f270fd tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:09.709477 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-c2e58008-ec47-4cc6-ba20-0376f5f270fd tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:09.717236 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c2e58008-ec47-4cc6-ba20-0376f5f270fd tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1569 microversion: 2.1 time: 0.188213 Aug 01 14:31:09.717822 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 568/1125] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:09 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:10.741490 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-79af7d2a-f2b3-43f3-ae7d-a42dbbab494b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:10.742191 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-79af7d2a-f2b3-43f3-ae7d-a42dbbab494b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:10.748568 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-79af7d2a-f2b3-43f3-ae7d-a42dbbab494b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:10.749019 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-79af7d2a-f2b3-43f3-ae7d-a42dbbab494b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:10.749799 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-79af7d2a-f2b3-43f3-ae7d-a42dbbab494b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:10.750241 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-79af7d2a-f2b3-43f3-ae7d-a42dbbab494b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:10.889814 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-79af7d2a-f2b3-43f3-ae7d-a42dbbab494b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:10.897579 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-79af7d2a-f2b3-43f3-ae7d-a42dbbab494b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1510 microversion: 2.1 time: 0.160968 Aug 01 14:31:10.898163 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 558/1126] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:10 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:10.918976 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-c66857ad-d8db-4236-99eb-25e66afe11e7 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:31:10.919586 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c66857ad-d8db-4236-99eb-25e66afe11e7 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:10.921898 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=30 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:10.928446 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c66857ad-d8db-4236-99eb-25e66afe11e7 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:10.928930 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c66857ad-d8db-4236-99eb-25e66afe11e7 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:10.929716 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c66857ad-d8db-4236-99eb-25e66afe11e7 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:10.930153 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-c66857ad-d8db-4236-99eb-25e66afe11e7 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:10.960135 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-c66857ad-d8db-4236-99eb-25e66afe11e7 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118132) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 14:31:11.034421 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-c66857ad-d8db-4236-99eb-25e66afe11e7 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "POST /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70/action" status: 202 len: 0 microversion: 2.1 time: 0.119589 Aug 01 14:31:11.035012 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 569/1127] 10.222.0.17 () {60 vars in 1278 bytes} [Mon Aug 1 14:31:10 2022] POST /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:31:11.049281 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-77aa91e8-3701-4eca-bfcb-c365f9e01088 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:11.050887 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-77aa91e8-3701-4eca-bfcb-c365f9e01088 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:11.059816 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-77aa91e8-3701-4eca-bfcb-c365f9e01088 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:11.060395 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-77aa91e8-3701-4eca-bfcb-c365f9e01088 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:11.061526 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-77aa91e8-3701-4eca-bfcb-c365f9e01088 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:11.062018 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-77aa91e8-3701-4eca-bfcb-c365f9e01088 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:11.254226 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-77aa91e8-3701-4eca-bfcb-c365f9e01088 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:11.256798 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:11.263239 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-77aa91e8-3701-4eca-bfcb-c365f9e01088 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1518 microversion: 2.1 time: 0.222629 Aug 01 14:31:11.263850 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 559/1128] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:11 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1518 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:31:12.285823 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-bcdd630b-d4c9-4c93-a64c-2db40a57b96e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:12.286430 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-bcdd630b-d4c9-4c93-a64c-2db40a57b96e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:12.292475 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bcdd630b-d4c9-4c93-a64c-2db40a57b96e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:12.292917 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bcdd630b-d4c9-4c93-a64c-2db40a57b96e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:12.293668 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bcdd630b-d4c9-4c93-a64c-2db40a57b96e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:12.294089 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-bcdd630b-d4c9-4c93-a64c-2db40a57b96e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:12.424294 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-bcdd630b-d4c9-4c93-a64c-2db40a57b96e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:12.431808 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-bcdd630b-d4c9-4c93-a64c-2db40a57b96e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1520 microversion: 2.1 time: 0.150412 Aug 01 14:31:12.432374 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 570/1129] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:12 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:13.105642 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-8dcdb20d-013e-4349-9dc8-fb0e586091a0 req-f15b7305-4597-4e4e-926f-6fcc93843a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e51815a-0d9e-494f-8960-a75433080b70", "name": "network-vif-unplugged", "status": "completed", "tag": "4bdcf192-f56a-4ae6-a4bb-17090119b4d9"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:31:13.114567 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=32 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:13.124640 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-8dcdb20d-013e-4349-9dc8-fb0e586091a0 req-f15b7305-4597-4e4e-926f-6fcc93843a4e service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:13.125422 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-8dcdb20d-013e-4349-9dc8-fb0e586091a0 req-f15b7305-4597-4e4e-926f-6fcc93843a4e service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:13.146962 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.compute.server_external_events [req-8dcdb20d-013e-4349-9dc8-fb0e586091a0 req-f15b7305-4597-4e4e-926f-6fcc93843a4e service nova] Unable to find a host for instance 3e51815a-0d9e-494f-8960-a75433080b70. Dropping event network-vif-unplugged {{(pid=118133) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 01 14:31:13.148590 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-8dcdb20d-013e-4349-9dc8-fb0e586091a0 req-f15b7305-4597-4e4e-926f-6fcc93843a4e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.109869 Aug 01 14:31:13.149622 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 560/1130] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 112 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 01 14:31:13.453539 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-694772fa-d216-4bbe-86c6-b2342dc4f96d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:13.454136 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-694772fa-d216-4bbe-86c6-b2342dc4f96d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:13.461599 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-694772fa-d216-4bbe-86c6-b2342dc4f96d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:13.462048 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-694772fa-d216-4bbe-86c6-b2342dc4f96d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:13.462829 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-694772fa-d216-4bbe-86c6-b2342dc4f96d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:13.463263 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-694772fa-d216-4bbe-86c6-b2342dc4f96d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:13.863329 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-694772fa-d216-4bbe-86c6-b2342dc4f96d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:13.870980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-694772fa-d216-4bbe-86c6-b2342dc4f96d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1520 microversion: 2.1 time: 0.421510 Aug 01 14:31:13.871592 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 571/1131] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:13 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1520 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:14.892850 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ba2abca0-a5bf-4e89-b917-87489e60e4da tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:14.893450 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ba2abca0-a5bf-4e89-b917-87489e60e4da tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:14.899940 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ba2abca0-a5bf-4e89-b917-87489e60e4da tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:14.900383 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ba2abca0-a5bf-4e89-b917-87489e60e4da tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:14.901143 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ba2abca0-a5bf-4e89-b917-87489e60e4da tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:14.901609 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ba2abca0-a5bf-4e89-b917-87489e60e4da tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:15.038351 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ba2abca0-a5bf-4e89-b917-87489e60e4da tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:15.046401 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ba2abca0-a5bf-4e89-b917-87489e60e4da tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1520 microversion: 2.1 time: 0.158039 Aug 01 14:31:15.046990 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 561/1132] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:14 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:16.068845 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0f754b8c-fe75-4ffb-95db-454a7f7569c9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:16.069486 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0f754b8c-fe75-4ffb-95db-454a7f7569c9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:16.076028 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0f754b8c-fe75-4ffb-95db-454a7f7569c9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:16.076476 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0f754b8c-fe75-4ffb-95db-454a7f7569c9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:16.077224 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0f754b8c-fe75-4ffb-95db-454a7f7569c9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:16.077655 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0f754b8c-fe75-4ffb-95db-454a7f7569c9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:16.208138 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0f754b8c-fe75-4ffb-95db-454a7f7569c9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:16.216880 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0f754b8c-fe75-4ffb-95db-454a7f7569c9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1520 microversion: 2.1 time: 0.151831 Aug 01 14:31:16.217462 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 572/1133] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:16 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:16.903251 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-21d901b8-91b7-4ef4-b326-1b2448c9fdcc tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:16.905461 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-21d901b8-91b7-4ef4-b326-1b2448c9fdcc tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:16.912943 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-21d901b8-91b7-4ef4-b326-1b2448c9fdcc tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:16.913338 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-21d901b8-91b7-4ef4-b326-1b2448c9fdcc tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:16.914101 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-21d901b8-91b7-4ef4-b326-1b2448c9fdcc tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:16.914534 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-21d901b8-91b7-4ef4-b326-1b2448c9fdcc tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:16.944692 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-21d901b8-91b7-4ef4-b326-1b2448c9fdcc tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045423 Aug 01 14:31:16.945251 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 562/1134] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Aug 1 14:31:16 2022] GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:31:16.957072 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-16665f19-3ee2-4a3b-b5c4-a9942929e6ee tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:16.957560 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-16665f19-3ee2-4a3b-b5c4-a9942929e6ee tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:16.963890 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-16665f19-3ee2-4a3b-b5c4-a9942929e6ee tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:16.964336 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-16665f19-3ee2-4a3b-b5c4-a9942929e6ee tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:16.965094 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-16665f19-3ee2-4a3b-b5c4-a9942929e6ee tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:16.965532 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-16665f19-3ee2-4a3b-b5c4-a9942929e6ee tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:16.994982 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-16665f19-3ee2-4a3b-b5c4-a9942929e6ee tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03/os-volume_attachments/9c689619-ff12-4af6-859a-827c7cb247e4" status: 200 len: 194 microversion: 2.1 time: 0.042566 Aug 01 14:31:16.995594 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 573/1135] 10.222.0.17 () {58 vars in 1413 bytes} [Mon Aug 1 14:31:16 2022] GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03/os-volume_attachments/9c689619-ff12-4af6-859a-827c7cb247e4 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:31:17.238558 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-cfba124e-356a-49d5-b6e8-f879912e2bca tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:17.239188 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-cfba124e-356a-49d5-b6e8-f879912e2bca tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:17.246818 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cfba124e-356a-49d5-b6e8-f879912e2bca tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:17.247320 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cfba124e-356a-49d5-b6e8-f879912e2bca tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:17.248519 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cfba124e-356a-49d5-b6e8-f879912e2bca tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:17.249163 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cfba124e-356a-49d5-b6e8-f879912e2bca tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:17.406463 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-cfba124e-356a-49d5-b6e8-f879912e2bca tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:17.416204 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-cfba124e-356a-49d5-b6e8-f879912e2bca tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1520 microversion: 2.1 time: 0.181701 Aug 01 14:31:17.417405 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 563/1136] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:17 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:18.439901 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-83fdfe5b-ca86-44ae-8df8-247f96e63cee tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:18.440642 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-83fdfe5b-ca86-44ae-8df8-247f96e63cee tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:18.447294 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-83fdfe5b-ca86-44ae-8df8-247f96e63cee tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:18.448065 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-83fdfe5b-ca86-44ae-8df8-247f96e63cee tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:18.448828 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-83fdfe5b-ca86-44ae-8df8-247f96e63cee tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:18.449301 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-83fdfe5b-ca86-44ae-8df8-247f96e63cee tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:18.552159 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8718d9a0-63be-433e-845c-0696f7568bb3 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f872bb8-f8cf-40b7-a655-f8641c3420d6"}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:31:18.554528 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8718d9a0-63be-433e-845c-0696f7568bb3 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:18.561150 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8718d9a0-63be-433e-845c-0696f7568bb3 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:18.561604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8718d9a0-63be-433e-845c-0696f7568bb3 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:18.562379 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8718d9a0-63be-433e-845c-0696f7568bb3 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:18.562821 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8718d9a0-63be-433e-845c-0696f7568bb3 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:18.597275 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-83fdfe5b-ca86-44ae-8df8-247f96e63cee tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:18.605314 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-83fdfe5b-ca86-44ae-8df8-247f96e63cee tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1576 microversion: 2.1 time: 0.170917 Aug 01 14:31:18.605895 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 574/1137] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:18 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:18.961022 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8718d9a0-63be-433e-845c-0696f7568bb3 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "POST /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.413252 Aug 01 14:31:18.961695 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 564/1138] 10.222.0.17 () {60 vars in 1323 bytes} [Mon Aug 1 14:31:18 2022] POST /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03/os-volume_attachments => generated 194 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:31:19.626769 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-fce808f6-10ba-47bb-b920-492abfc5cd0e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:19.627382 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-fce808f6-10ba-47bb-b920-492abfc5cd0e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:19.633914 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fce808f6-10ba-47bb-b920-492abfc5cd0e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:19.634355 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fce808f6-10ba-47bb-b920-492abfc5cd0e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:19.635109 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fce808f6-10ba-47bb-b920-492abfc5cd0e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:19.635573 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-fce808f6-10ba-47bb-b920-492abfc5cd0e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:19.770681 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-fce808f6-10ba-47bb-b920-492abfc5cd0e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:19.778229 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-fce808f6-10ba-47bb-b920-492abfc5cd0e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1576 microversion: 2.1 time: 0.155887 Aug 01 14:31:19.778792 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 575/1139] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:19 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:20.799428 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-07e68126-26b8-4c79-96cd-568bc0b89c81 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:20.800146 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-07e68126-26b8-4c79-96cd-568bc0b89c81 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:20.806366 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-07e68126-26b8-4c79-96cd-568bc0b89c81 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:20.806804 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-07e68126-26b8-4c79-96cd-568bc0b89c81 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:20.807579 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-07e68126-26b8-4c79-96cd-568bc0b89c81 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:20.808010 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-07e68126-26b8-4c79-96cd-568bc0b89c81 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:20.936778 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-07e68126-26b8-4c79-96cd-568bc0b89c81 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:20.944941 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-07e68126-26b8-4c79-96cd-568bc0b89c81 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1576 microversion: 2.1 time: 0.150242 Aug 01 14:31:20.945510 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 565/1140] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:20 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:21.966401 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6bae1d0c-de0a-49c4-ae2e-984ad36eac57 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:21.967170 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-6bae1d0c-de0a-49c4-ae2e-984ad36eac57 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:21.974118 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6bae1d0c-de0a-49c4-ae2e-984ad36eac57 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:21.974965 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6bae1d0c-de0a-49c4-ae2e-984ad36eac57 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:21.975342 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6bae1d0c-de0a-49c4-ae2e-984ad36eac57 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:21.975805 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-6bae1d0c-de0a-49c4-ae2e-984ad36eac57 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:22.113708 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-6bae1d0c-de0a-49c4-ae2e-984ad36eac57 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:22.121328 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6bae1d0c-de0a-49c4-ae2e-984ad36eac57 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1576 microversion: 2.1 time: 0.158880 Aug 01 14:31:22.121889 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 576/1141] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:21 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:23.142196 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-461dee65-1f3b-42aa-b3b3-75a3de0ee38e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:23.142852 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-461dee65-1f3b-42aa-b3b3-75a3de0ee38e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:23.149482 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-461dee65-1f3b-42aa-b3b3-75a3de0ee38e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:23.149925 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-461dee65-1f3b-42aa-b3b3-75a3de0ee38e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:23.150700 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-461dee65-1f3b-42aa-b3b3-75a3de0ee38e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:23.151128 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-461dee65-1f3b-42aa-b3b3-75a3de0ee38e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:23.300766 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-461dee65-1f3b-42aa-b3b3-75a3de0ee38e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:23.309265 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-461dee65-1f3b-42aa-b3b3-75a3de0ee38e tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1576 microversion: 2.1 time: 0.170874 Aug 01 14:31:23.309848 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 566/1142] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:23 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:24.330990 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2cf54c06-c34f-46e9-a84e-5d4357a73c2a tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:24.331621 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2cf54c06-c34f-46e9-a84e-5d4357a73c2a tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:24.338164 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2cf54c06-c34f-46e9-a84e-5d4357a73c2a tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:24.338602 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2cf54c06-c34f-46e9-a84e-5d4357a73c2a tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:24.339348 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2cf54c06-c34f-46e9-a84e-5d4357a73c2a tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:24.339799 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2cf54c06-c34f-46e9-a84e-5d4357a73c2a tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:24.468179 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-2cf54c06-c34f-46e9-a84e-5d4357a73c2a tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:24.476198 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2cf54c06-c34f-46e9-a84e-5d4357a73c2a tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1576 microversion: 2.1 time: 0.149107 Aug 01 14:31:24.476757 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 577/1143] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:24 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:25.498272 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7b69df61-e112-4c48-9bc3-c86afe580848 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:25.498860 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7b69df61-e112-4c48-9bc3-c86afe580848 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:25.505489 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7b69df61-e112-4c48-9bc3-c86afe580848 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:25.505940 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7b69df61-e112-4c48-9bc3-c86afe580848 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:25.506697 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7b69df61-e112-4c48-9bc3-c86afe580848 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:25.507126 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7b69df61-e112-4c48-9bc3-c86afe580848 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:25.638113 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7b69df61-e112-4c48-9bc3-c86afe580848 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:25.646346 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7b69df61-e112-4c48-9bc3-c86afe580848 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1576 microversion: 2.1 time: 0.151912 Aug 01 14:31:25.647014 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 567/1144] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:25 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:26.507576 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-53ffcbd6-89b7-4cd1-bfd0-8300623ab627 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:26.509653 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-53ffcbd6-89b7-4cd1-bfd0-8300623ab627 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:26.516084 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-53ffcbd6-89b7-4cd1-bfd0-8300623ab627 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:26.516522 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-53ffcbd6-89b7-4cd1-bfd0-8300623ab627 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:26.517285 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-53ffcbd6-89b7-4cd1-bfd0-8300623ab627 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:26.517707 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-53ffcbd6-89b7-4cd1-bfd0-8300623ab627 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:26.545993 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-53ffcbd6-89b7-4cd1-bfd0-8300623ab627 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042481 Aug 01 14:31:26.546523 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 578/1145] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Aug 1 14:31:26 2022] GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:31:26.667735 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-16b339c6-1147-4b05-868e-541acfedfc9d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:26.668342 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-16b339c6-1147-4b05-868e-541acfedfc9d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:26.675620 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-16b339c6-1147-4b05-868e-541acfedfc9d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:26.676074 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-16b339c6-1147-4b05-868e-541acfedfc9d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:26.676854 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-16b339c6-1147-4b05-868e-541acfedfc9d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:26.677286 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-16b339c6-1147-4b05-868e-541acfedfc9d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:26.694333 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-9ceed0c6-4b44-4c1c-87b4-6583651bdd43 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:26.694828 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-9ceed0c6-4b44-4c1c-87b4-6583651bdd43 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:26.700967 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9ceed0c6-4b44-4c1c-87b4-6583651bdd43 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:26.701408 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9ceed0c6-4b44-4c1c-87b4-6583651bdd43 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:26.702175 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9ceed0c6-4b44-4c1c-87b4-6583651bdd43 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:26.702606 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-9ceed0c6-4b44-4c1c-87b4-6583651bdd43 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:26.737886 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-9ceed0c6-4b44-4c1c-87b4-6583651bdd43 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03/os-volume_attachments/9c689619-ff12-4af6-859a-827c7cb247e4" status: 200 len: 194 microversion: 2.1 time: 0.047442 Aug 01 14:31:26.738504 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 579/1146] 10.222.0.17 () {58 vars in 1413 bytes} [Mon Aug 1 14:31:26 2022] GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03/os-volume_attachments/9c689619-ff12-4af6-859a-827c7cb247e4 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:31:26.749283 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-92c705c2-ac73-4716-a0bf-871eaf3ee82e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:26.749772 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-92c705c2-ac73-4716-a0bf-871eaf3ee82e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:26.756480 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-92c705c2-ac73-4716-a0bf-871eaf3ee82e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:26.756964 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-92c705c2-ac73-4716-a0bf-871eaf3ee82e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:26.757813 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-92c705c2-ac73-4716-a0bf-871eaf3ee82e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:26.758221 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-92c705c2-ac73-4716-a0bf-871eaf3ee82e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:26.827065 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-16b339c6-1147-4b05-868e-541acfedfc9d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:26.834586 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-16b339c6-1147-4b05-868e-541acfedfc9d tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1576 microversion: 2.1 time: 0.170925 Aug 01 14:31:26.835385 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 568/1147] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:26 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:26.849564 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-92c705c2-ac73-4716-a0bf-871eaf3ee82e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lazy-loading 'services' on Instance uuid 09455b95-58be-4c8c-b8f4-5969ed769c03 {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:31:26.922890 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-92c705c2-ac73-4716-a0bf-871eaf3ee82e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "DELETE /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03/os-volume_attachments/9c689619-ff12-4af6-859a-827c7cb247e4" status: 202 len: 0 microversion: 2.1 time: 0.177624 Aug 01 14:31:26.924121 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 580/1148] 10.222.0.17 () {58 vars in 1416 bytes} [Mon Aug 1 14:31:26 2022] DELETE /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03/os-volume_attachments/9c689619-ff12-4af6-859a-827c7cb247e4 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 14:31:27.856398 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a1100f5a-51b6-4f54-80a7-7d301b160ef9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:27.857052 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a1100f5a-51b6-4f54-80a7-7d301b160ef9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:27.864615 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a1100f5a-51b6-4f54-80a7-7d301b160ef9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:27.865771 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a1100f5a-51b6-4f54-80a7-7d301b160ef9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:27.866556 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a1100f5a-51b6-4f54-80a7-7d301b160ef9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:27.866988 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a1100f5a-51b6-4f54-80a7-7d301b160ef9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:28.006397 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a1100f5a-51b6-4f54-80a7-7d301b160ef9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:28.013914 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a1100f5a-51b6-4f54-80a7-7d301b160ef9 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1576 microversion: 2.1 time: 0.161691 Aug 01 14:31:28.014895 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 569/1149] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:27 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:29.036982 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-d53ef176-e2d8-4369-97fd-ef2936227956 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:29.037774 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-d53ef176-e2d8-4369-97fd-ef2936227956 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:29.044258 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d53ef176-e2d8-4369-97fd-ef2936227956 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:29.044712 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d53ef176-e2d8-4369-97fd-ef2936227956 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:29.045525 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d53ef176-e2d8-4369-97fd-ef2936227956 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:29.045965 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-d53ef176-e2d8-4369-97fd-ef2936227956 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:29.114828 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ce8a1adb-e39d-49d0-8625-c12e1f29352a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:29.115427 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ce8a1adb-e39d-49d0-8625-c12e1f29352a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:29.122204 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ce8a1adb-e39d-49d0-8625-c12e1f29352a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:29.122644 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ce8a1adb-e39d-49d0-8625-c12e1f29352a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:29.123665 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ce8a1adb-e39d-49d0-8625-c12e1f29352a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:29.124107 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ce8a1adb-e39d-49d0-8625-c12e1f29352a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:29.155266 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ce8a1adb-e39d-49d0-8625-c12e1f29352a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03/os-volume_attachments/2f872bb8-f8cf-40b7-a655-f8641c3420d6" status: 200 len: 194 microversion: 2.1 time: 0.045110 Aug 01 14:31:29.162232 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 570/1150] 10.222.0.17 () {58 vars in 1413 bytes} [Mon Aug 1 14:31:29 2022] GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03/os-volume_attachments/2f872bb8-f8cf-40b7-a655-f8641c3420d6 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:31:29.168090 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-82f56ef0-def3-4cc4-862b-f029761b1d1a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:29.168929 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-82f56ef0-def3-4cc4-862b-f029761b1d1a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:29.175447 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-82f56ef0-def3-4cc4-862b-f029761b1d1a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:29.175928 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-82f56ef0-def3-4cc4-862b-f029761b1d1a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:29.176768 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-82f56ef0-def3-4cc4-862b-f029761b1d1a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:29.177213 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-82f56ef0-def3-4cc4-862b-f029761b1d1a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:29.200974 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-d53ef176-e2d8-4369-97fd-ef2936227956 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:29.212111 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-d53ef176-e2d8-4369-97fd-ef2936227956 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1576 microversion: 2.1 time: 0.180652 Aug 01 14:31:29.225249 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 581/1151] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:29 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:29.225249 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-85459fa6-e2f7-47b4-9ba8-088fd597652b req-2663a4d1-83ce-4951-8738-7a16ff8b9ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e51815a-0d9e-494f-8960-a75433080b70", "name": "network-vif-plugged", "status": "completed", "tag": "4bdcf192-f56a-4ae6-a4bb-17090119b4d9"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:31:29.230294 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-85459fa6-e2f7-47b4-9ba8-088fd597652b req-2663a4d1-83ce-4951-8738-7a16ff8b9ac1 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:29.230740 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-85459fa6-e2f7-47b4-9ba8-088fd597652b req-2663a4d1-83ce-4951-8738-7a16ff8b9ac1 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:29.235488 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:29.245866 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-85459fa6-e2f7-47b4-9ba8-088fd597652b req-2663a4d1-83ce-4951-8738-7a16ff8b9ac1 service nova] Creating event network-vif-plugged:4bdcf192-f56a-4ae6-a4bb-17090119b4d9 for instance 3e51815a-0d9e-494f-8960-a75433080b70 on hv-cinder-84599 Aug 01 14:31:29.252388 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-85459fa6-e2f7-47b4-9ba8-088fd597652b req-2663a4d1-83ce-4951-8738-7a16ff8b9ac1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037630 Aug 01 14:31:29.253177 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 582/1152] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:31:29.271841 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-82f56ef0-def3-4cc4-862b-f029761b1d1a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lazy-loading 'services' on Instance uuid 09455b95-58be-4c8c-b8f4-5969ed769c03 {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:31:29.348706 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-82f56ef0-def3-4cc4-862b-f029761b1d1a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "DELETE /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03/os-volume_attachments/2f872bb8-f8cf-40b7-a655-f8641c3420d6" status: 202 len: 0 microversion: 2.1 time: 0.184612 Aug 01 14:31:29.349295 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 571/1153] 10.222.0.17 () {58 vars in 1416 bytes} [Mon Aug 1 14:31:29 2022] DELETE /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03/os-volume_attachments/2f872bb8-f8cf-40b7-a655-f8641c3420d6 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 14:31:30.236879 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-33bd85ea-3b53-4b31-9109-da0c76cbe738 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:30.237479 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-33bd85ea-3b53-4b31-9109-da0c76cbe738 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:30.245340 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-33bd85ea-3b53-4b31-9109-da0c76cbe738 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:30.245780 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-33bd85ea-3b53-4b31-9109-da0c76cbe738 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:30.246528 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-33bd85ea-3b53-4b31-9109-da0c76cbe738 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:30.246953 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-33bd85ea-3b53-4b31-9109-da0c76cbe738 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:30.398666 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-33bd85ea-3b53-4b31-9109-da0c76cbe738 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:30.406172 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-33bd85ea-3b53-4b31-9109-da0c76cbe738 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1576 microversion: 2.1 time: 0.174172 Aug 01 14:31:30.406732 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 583/1154] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:30 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:31.433041 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-136cd5f0-527c-48ba-8b4b-523497e88cd7 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:31.433841 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-136cd5f0-527c-48ba-8b4b-523497e88cd7 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:31.440239 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-136cd5f0-527c-48ba-8b4b-523497e88cd7 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:31.440691 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-136cd5f0-527c-48ba-8b4b-523497e88cd7 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:31.441456 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-136cd5f0-527c-48ba-8b4b-523497e88cd7 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:31.441888 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-136cd5f0-527c-48ba-8b4b-523497e88cd7 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:31.583344 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-136cd5f0-527c-48ba-8b4b-523497e88cd7 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:31.589016 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-2a50f65f-011e-4ad4-8f2b-17db910c5f66 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:31.591204 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-2a50f65f-011e-4ad4-8f2b-17db910c5f66 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:31.591333 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-136cd5f0-527c-48ba-8b4b-523497e88cd7 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1563 microversion: 2.1 time: 0.166230 Aug 01 14:31:31.591889 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 572/1155] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:31 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:31.600107 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2a50f65f-011e-4ad4-8f2b-17db910c5f66 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:31.602372 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2a50f65f-011e-4ad4-8f2b-17db910c5f66 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:31.603586 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2a50f65f-011e-4ad4-8f2b-17db910c5f66 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:31.604034 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-2a50f65f-011e-4ad4-8f2b-17db910c5f66 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:31.633182 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-2a50f65f-011e-4ad4-8f2b-17db910c5f66 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047997 Aug 01 14:31:31.633735 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 584/1156] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Aug 1 14:31:31 2022] GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 01 14:31:31.746433 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-88a203fe-cae6-4c8c-acbb-1e28014a702f tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:31.748738 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-88a203fe-cae6-4c8c-acbb-1e28014a702f tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:31.754726 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-88a203fe-cae6-4c8c-acbb-1e28014a702f tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:31.755173 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-88a203fe-cae6-4c8c-acbb-1e28014a702f tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:31.755968 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-88a203fe-cae6-4c8c-acbb-1e28014a702f tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:31.756405 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-88a203fe-cae6-4c8c-acbb-1e28014a702f tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:31.785394 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-88a203fe-cae6-4c8c-acbb-1e28014a702f tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042914 Aug 01 14:31:31.785986 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 573/1157] 10.222.0.17 () {58 vars in 1302 bytes} [Mon Aug 1 14:31:31 2022] GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:31:31.858499 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-84eb07df-b383-42e9-a06b-0a8c726ed513 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:31.858985 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-84eb07df-b383-42e9-a06b-0a8c726ed513 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:31.865007 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-84eb07df-b383-42e9-a06b-0a8c726ed513 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:31.865445 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-84eb07df-b383-42e9-a06b-0a8c726ed513 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:31.866195 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-84eb07df-b383-42e9-a06b-0a8c726ed513 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:31.866618 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-84eb07df-b383-42e9-a06b-0a8c726ed513 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:31.890895 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-84eb07df-b383-42e9-a06b-0a8c726ed513 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Going to try to terminate instance {{(pid=118132) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:31:31.963791 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-84eb07df-b383-42e9-a06b-0a8c726ed513 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "DELETE /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03" status: 204 len: 0 microversion: 2.1 time: 0.108936 Aug 01 14:31:31.964305 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 585/1158] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Aug 1 14:31:31 2022] DELETE /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:31:31.972673 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9da4df5f-e339-481b-876b-21786f0ff27e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:31.973280 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9da4df5f-e339-481b-876b-21786f0ff27e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:31.979249 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9da4df5f-e339-481b-876b-21786f0ff27e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:31.979995 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9da4df5f-e339-481b-876b-21786f0ff27e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:31.980757 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9da4df5f-e339-481b-876b-21786f0ff27e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:31.981189 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9da4df5f-e339-481b-876b-21786f0ff27e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:32.112927 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9da4df5f-e339-481b-876b-21786f0ff27e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:32.120465 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9da4df5f-e339-481b-876b-21786f0ff27e tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03" status: 200 len: 1672 microversion: 2.1 time: 0.151729 Aug 01 14:31:32.121024 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 574/1159] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:31 2022] GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:31:33.143305 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-25cb1cea-a266-41d6-ae66-ca4ead3c2c52 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:33.144028 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-25cb1cea-a266-41d6-ae66-ca4ead3c2c52 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:33.150479 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-25cb1cea-a266-41d6-ae66-ca4ead3c2c52 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:33.150927 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-25cb1cea-a266-41d6-ae66-ca4ead3c2c52 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:33.151718 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-25cb1cea-a266-41d6-ae66-ca4ead3c2c52 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:33.152157 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-25cb1cea-a266-41d6-ae66-ca4ead3c2c52 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:33.286010 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-25cb1cea-a266-41d6-ae66-ca4ead3c2c52 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:33.297543 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-25cb1cea-a266-41d6-ae66-ca4ead3c2c52 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03" status: 200 len: 1672 microversion: 2.1 time: 0.158806 Aug 01 14:31:33.298520 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 586/1160] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:33 2022] GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:34.321452 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-dcea5d07-2931-4dc4-b752-ee8924fa750a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:34.321986 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-dcea5d07-2931-4dc4-b752-ee8924fa750a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:34.328772 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dcea5d07-2931-4dc4-b752-ee8924fa750a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:34.329295 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dcea5d07-2931-4dc4-b752-ee8924fa750a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:34.330145 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dcea5d07-2931-4dc4-b752-ee8924fa750a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:34.330578 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dcea5d07-2931-4dc4-b752-ee8924fa750a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:34.333505 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:34.473420 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-dcea5d07-2931-4dc4-b752-ee8924fa750a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4079529de70f4994ab9f1f3dd5cb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a93cc41a184683a1fb82acfa2660a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:34.481208 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-dcea5d07-2931-4dc4-b752-ee8924fa750a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03" status: 200 len: 1672 microversion: 2.1 time: 0.163689 Aug 01 14:31:34.481781 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 575/1161] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:34 2022] GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03 => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:34.896634 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-f767ecf3-8a4b-4869-beb3-1b3684d7ede1 req-455ab7a4-8f41-4d7f-aafc-2be9bde8d250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09455b95-58be-4c8c-b8f4-5969ed769c03", "name": "network-vif-deleted", "tag": "dc0ba090-64fe-4fe6-ab75-2767eeb3bdd9"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:31:34.907049 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-f767ecf3-8a4b-4869-beb3-1b3684d7ede1 req-455ab7a4-8f41-4d7f-aafc-2be9bde8d250 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:34.907631 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-f767ecf3-8a4b-4869-beb3-1b3684d7ede1 req-455ab7a4-8f41-4d7f-aafc-2be9bde8d250 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:34.920654 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-f767ecf3-8a4b-4869-beb3-1b3684d7ede1 req-455ab7a4-8f41-4d7f-aafc-2be9bde8d250 service nova] Creating event network-vif-deleted:dc0ba090-64fe-4fe6-ab75-2767eeb3bdd9 for instance 09455b95-58be-4c8c-b8f4-5969ed769c03 on hv-cinder-84599 Aug 01 14:31:34.926180 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-f767ecf3-8a4b-4869-beb3-1b3684d7ede1 req-455ab7a4-8f41-4d7f-aafc-2be9bde8d250 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104446 Aug 01 14:31:34.926957 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 587/1162] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:31:35.503064 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e05e96ef-cd39-4109-bc22-2ae3eda65182 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:35.503700 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e05e96ef-cd39-4109-bc22-2ae3eda65182 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:35.510449 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e05e96ef-cd39-4109-bc22-2ae3eda65182 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:35.510894 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e05e96ef-cd39-4109-bc22-2ae3eda65182 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:35.511679 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e05e96ef-cd39-4109-bc22-2ae3eda65182 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:35.512106 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e05e96ef-cd39-4109-bc22-2ae3eda65182 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:35.526596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-e05e96ef-cd39-4109-bc22-2ae3eda65182 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] HTTP exception thrown: Instance 09455b95-58be-4c8c-b8f4-5969ed769c03 could not be found. Aug 01 14:31:35.528299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e05e96ef-cd39-4109-bc22-2ae3eda65182 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Request method failure captured: Aug 01 14:31:35.528299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03 HTTP/1.1 Aug 01 14:31:35.528299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:31:35.528299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:31:35.528299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:31:35.528299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 0 Aug 01 14:31:35.528299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:31:35.528299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:31:35.528299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:31:35.528299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:31:35.528299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-K78faWMgu8mzA4Eg8pgsiGxTE6pBXhmPQojigyrNjIMs1R9adp28mi7VvKThaG50jD5wKdwDz7gzAJrj7AtVL0Rk_xR189lfsf40Nm3HxixhapJZjfNBrZScoAKOd8VMLb2ykHjXYrSPq9SiJe7buVp5udlI1E05AGLj0LDk6Nq5Q Aug 01 14:31:35.528299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:31:35.528299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:31:35.528299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:31:35.528299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:31:35.528299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:31:35.528299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:31:35.528299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: 00a93cc41a184683a1fb82acfa2660a6 Aug 01 14:31:35.528299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-AttachVolumeTestJSON-69766420 Aug 01 14:31:35.528299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:31:35.528299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:31:35.530007 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/00a93cc41a184683a1fb82acfa2660a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/00a93cc41a184683a1fb82acfa2660a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/00a93cc41a184683a1fb82acfa2660a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_00a93cc41a184683a1fb82acfa2660a6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:31:35.530007 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-AttachVolumeTestJSON-69766420 Aug 01 14:31:35.530007 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 00a93cc41a184683a1fb82acfa2660a6 Aug 01 14:31:35.530007 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-AttachVolumeTestJSON-69766420 Aug 01 14:31:35.530007 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-AttachVolumeTestJSON-69766420-project Aug 01 14:31:35.530007 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:31:35.530007 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:31:35.530007 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: 4079529de70f4994ab9f1f3dd5cb3fd7 Aug 01 14:31:35.530007 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-AttachVolumeTestJSON-69766420-project Aug 01 14:31:35.530007 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: > Aug 01 14:31:35.530007 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Instance 09455b95-58be-4c8c-b8f4-5969ed769c03 could not be found. Aug 01 14:31:35.530007 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'id': '09455b95-58be-4c8c-b8f4-5969ed769c03'} Aug 01 14:31:35.531101 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:31:35.531101 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:31:35.531101 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:31:35.531101 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:31:35.531101 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:31:35.531101 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:31:35.531101 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:31:35.531101 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:31:35.531101 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:31:35.531101 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:31:35.531101 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09455b95-58be-4c8c-b8f4-5969ed769c03 could not be found. Aug 01 14:31:35.531101 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:31:35.531101 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:31:35.531101 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:31:35.531101 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:31:35.531101 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:31:35.531101 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:31:35.531101 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:31:35.531101 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:31:35.531101 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:31:35.532771 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:31:35.532771 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:31:35.532771 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:31:35.532771 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:31:35.532771 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:31:35.532771 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:31:35.532771 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:31:35.532771 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09455b95-58be-4c8c-b8f4-5969ed769c03 could not be found. Aug 01 14:31:35.532771 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:31:35.532771 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:31:35.532771 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:31:35.532771 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:31:35.532771 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:31:35.532771 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:31:35.532771 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:31:35.532771 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:31:35.532771 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09455b95-58be-4c8c-b8f4-5969ed769c03 could not be found. Aug 01 14:31:35.532771 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:31:35.534600 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e05e96ef-cd39-4109-bc22-2ae3eda65182 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Returning 404 to user: Instance 09455b95-58be-4c8c-b8f4-5969ed769c03 could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:31:35.534600 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e05e96ef-cd39-4109-bc22-2ae3eda65182 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03" status: 404 len: 111 microversion: 2.1 time: 0.031359 Aug 01 14:31:35.534600 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 576/1163] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:35 2022] GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:31:35.539394 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-6a92eba0-53cf-4dff-9e23-d9617543d8d3 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '.version_select at 0x7f6184ce2ee0>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:35.558470 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-6a92eba0-53cf-4dff-9e23-d9617543d8d3 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-428064898" status: 202 len: 0 microversion: 2.1 time: 0.023247 Aug 01 14:31:35.559035 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 588/1164] 10.222.0.17 () {58 vars in 1218 bytes} [Mon Aug 1 14:31:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-428064898 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:31:38.455737 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-fd100a53-fcdd-49ad-ba27-9ff0a42b47e3 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:38.456282 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-fd100a53-fcdd-49ad-ba27-9ff0a42b47e3 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:38.463021 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fd100a53-fcdd-49ad-ba27-9ff0a42b47e3 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:38.463494 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fd100a53-fcdd-49ad-ba27-9ff0a42b47e3 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:38.464281 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fd100a53-fcdd-49ad-ba27-9ff0a42b47e3 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:38.464719 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fd100a53-fcdd-49ad-ba27-9ff0a42b47e3 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:38.492700 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-fd100a53-fcdd-49ad-ba27-9ff0a42b47e3 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] HTTP exception thrown: Instance 09455b95-58be-4c8c-b8f4-5969ed769c03 could not be found. Aug 01 14:31:38.494267 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-fd100a53-fcdd-49ad-ba27-9ff0a42b47e3 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Request method failure captured: Aug 01 14:31:38.494267 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: DELETE /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03 HTTP/1.1 Aug 01 14:31:38.494267 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:31:38.494267 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:31:38.494267 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:31:38.494267 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 0 Aug 01 14:31:38.494267 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:31:38.494267 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:31:38.494267 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:31:38.494267 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:31:38.494267 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-K78faWMgu8mzA4Eg8pgsiGxTE6pBXhmPQojigyrNjIMs1R9adp28mi7VvKThaG50jD5wKdwDz7gzAJrj7AtVL0Rk_xR189lfsf40Nm3HxixhapJZjfNBrZScoAKOd8VMLb2ykHjXYrSPq9SiJe7buVp5udlI1E05AGLj0LDk6Nq5Q Aug 01 14:31:38.494267 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:31:38.494267 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:31:38.494267 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:31:38.494267 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:31:38.494267 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:31:38.494267 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:31:38.494267 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: 00a93cc41a184683a1fb82acfa2660a6 Aug 01 14:31:38.494267 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-AttachVolumeTestJSON-69766420 Aug 01 14:31:38.494267 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:31:38.494267 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:31:38.496299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/00a93cc41a184683a1fb82acfa2660a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/00a93cc41a184683a1fb82acfa2660a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/00a93cc41a184683a1fb82acfa2660a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_00a93cc41a184683a1fb82acfa2660a6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:31:38.496299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-AttachVolumeTestJSON-69766420 Aug 01 14:31:38.496299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 00a93cc41a184683a1fb82acfa2660a6 Aug 01 14:31:38.496299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-AttachVolumeTestJSON-69766420 Aug 01 14:31:38.496299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-AttachVolumeTestJSON-69766420-project Aug 01 14:31:38.496299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:31:38.496299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:31:38.496299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: 4079529de70f4994ab9f1f3dd5cb3fd7 Aug 01 14:31:38.496299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-AttachVolumeTestJSON-69766420-project Aug 01 14:31:38.496299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: > Aug 01 14:31:38.496299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Instance 09455b95-58be-4c8c-b8f4-5969ed769c03 could not be found. Aug 01 14:31:38.496299 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'id': '09455b95-58be-4c8c-b8f4-5969ed769c03'} Aug 01 14:31:38.498070 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:31:38.498070 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:31:38.498070 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:31:38.498070 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:31:38.498070 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:31:38.498070 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:31:38.498070 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:31:38.498070 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:31:38.498070 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:31:38.498070 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:31:38.498070 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09455b95-58be-4c8c-b8f4-5969ed769c03 could not be found. Aug 01 14:31:38.498070 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:31:38.498070 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:31:38.498070 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:31:38.498070 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:31:38.498070 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:31:38.498070 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:31:38.498070 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:31:38.498070 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:31:38.498070 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:31:38.499607 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:31:38.499607 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:31:38.499607 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:31:38.499607 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:31:38.499607 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:31:38.499607 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:31:38.499607 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:31:38.499607 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:31:38.499607 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:31:38.499607 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09455b95-58be-4c8c-b8f4-5969ed769c03 could not be found. Aug 01 14:31:38.499607 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:31:38.499607 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:31:38.499607 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:31:38.499607 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:31:38.499607 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:31:38.499607 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:31:38.499607 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:31:38.499607 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:31:38.499607 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09455b95-58be-4c8c-b8f4-5969ed769c03 could not be found. Aug 01 14:31:38.499607 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:31:38.501110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-fd100a53-fcdd-49ad-ba27-9ff0a42b47e3 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Returning 404 to user: Instance 09455b95-58be-4c8c-b8f4-5969ed769c03 could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:31:38.501110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-fd100a53-fcdd-49ad-ba27-9ff0a42b47e3 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "DELETE /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03" status: 404 len: 111 microversion: 2.1 time: 0.044357 Aug 01 14:31:38.501110 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 577/1165] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Aug 1 14:31:38 2022] DELETE /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:31:38.504441 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ce55da08-9544-4260-90bb-31318991276a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:38.505240 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-ce55da08-9544-4260-90bb-31318991276a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 09455b95-58be-4c8c-b8f4-5969ed769c03] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:38.512060 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ce55da08-9544-4260-90bb-31318991276a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:38.512513 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ce55da08-9544-4260-90bb-31318991276a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:38.513274 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ce55da08-9544-4260-90bb-31318991276a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:38.513709 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-ce55da08-9544-4260-90bb-31318991276a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:38.527363 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-ce55da08-9544-4260-90bb-31318991276a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] HTTP exception thrown: Instance 09455b95-58be-4c8c-b8f4-5969ed769c03 could not be found. Aug 01 14:31:38.528997 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ce55da08-9544-4260-90bb-31318991276a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Request method failure captured: Aug 01 14:31:38.528997 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03 HTTP/1.1 Aug 01 14:31:38.528997 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept: application/json Aug 01 14:31:38.528997 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Aug 01 14:31:38.528997 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Connection: close Aug 01 14:31:38.528997 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Length: 0 Aug 01 14:31:38.528997 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Type: application/json Aug 01 14:31:38.528997 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Host: 10.222.0.17 Aug 01 14:31:38.528997 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Aug 01 14:31:38.528997 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.10 Aug 01 14:31:38.528997 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABi5-K78faWMgu8mzA4Eg8pgsiGxTE6pBXhmPQojigyrNjIMs1R9adp28mi7VvKThaG50jD5wKdwDz7gzAJrj7AtVL0Rk_xR189lfsf40Nm3HxixhapJZjfNBrZScoAKOd8VMLb2ykHjXYrSPq9SiJe7buVp5udlI1E05AGLj0LDk6Nq5Q Aug 01 14:31:38.528997 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Aug 01 14:31:38.528997 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Aug 01 14:31:38.528997 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Aug 01 14:31:38.528997 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Aug 01 14:31:38.528997 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Aug 01 14:31:38.528997 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Aug 01 14:31:38.528997 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Id: 00a93cc41a184683a1fb82acfa2660a6 Aug 01 14:31:38.528997 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-AttachVolumeTestJSON-69766420 Aug 01 14:31:38.528997 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Role: reader,member Aug 01 14:31:38.528997 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Roles: reader,member Aug 01 14:31:38.530583 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/00a93cc41a184683a1fb82acfa2660a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/00a93cc41a184683a1fb82acfa2660a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/00a93cc41a184683a1fb82acfa2660a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_00a93cc41a184683a1fb82acfa2660a6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:31:38.530583 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-AttachVolumeTestJSON-69766420 Aug 01 14:31:38.530583 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 00a93cc41a184683a1fb82acfa2660a6 Aug 01 14:31:38.530583 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-AttachVolumeTestJSON-69766420 Aug 01 14:31:38.530583 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User: tempest-AttachVolumeTestJSON-69766420-project Aug 01 14:31:38.530583 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Aug 01 14:31:38.530583 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Aug 01 14:31:38.530583 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Id: 4079529de70f4994ab9f1f3dd5cb3fd7 Aug 01 14:31:38.530583 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-AttachVolumeTestJSON-69766420-project Aug 01 14:31:38.530583 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: method: > Aug 01 14:31:38.530583 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: exception: Instance 09455b95-58be-4c8c-b8f4-5969ed769c03 could not be found. Aug 01 14:31:38.530583 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: action_args: {'id': '09455b95-58be-4c8c-b8f4-5969ed769c03'} Aug 01 14:31:38.531626 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:31:38.531626 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:31:38.531626 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:31:38.531626 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:31:38.531626 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:31:38.531626 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:31:38.531626 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:31:38.531626 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:31:38.531626 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:31:38.531626 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:31:38.531626 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09455b95-58be-4c8c-b8f4-5969ed769c03 could not be found. Aug 01 14:31:38.531626 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:31:38.531626 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:31:38.531626 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:31:38.531626 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:31:38.531626 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:31:38.531626 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:31:38.531626 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:31:38.531626 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:31:38.531626 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:31:38.533110 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:31:38.533110 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:31:38.533110 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:31:38.533110 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:31:38.533110 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:31:38.533110 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:31:38.533110 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:31:38.533110 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09455b95-58be-4c8c-b8f4-5969ed769c03 could not be found. Aug 01 14:31:38.533110 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:31:38.533110 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:31:38.533110 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:31:38.533110 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:31:38.533110 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:31:38.533110 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:31:38.533110 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:31:38.533110 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:31:38.533110 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09455b95-58be-4c8c-b8f4-5969ed769c03 could not be found. Aug 01 14:31:38.533110 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:31:38.534481 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-ce55da08-9544-4260-90bb-31318991276a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Returning 404 to user: Instance 09455b95-58be-4c8c-b8f4-5969ed769c03 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:31:38.534481 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-ce55da08-9544-4260-90bb-31318991276a tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03" status: 404 len: 111 microversion: 2.1 time: 0.029840 Aug 01 14:31:38.534481 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 589/1166] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:38 2022] GET /compute/v2.1/servers/09455b95-58be-4c8c-b8f4-5969ed769c03 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:31:39.664650 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3841a9ae-d452-47a4-a7fe-da07fb9f4fd6 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:39.665151 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3841a9ae-d452-47a4-a7fe-da07fb9f4fd6 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:39.671806 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3841a9ae-d452-47a4-a7fe-da07fb9f4fd6 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:39.672255 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3841a9ae-d452-47a4-a7fe-da07fb9f4fd6 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:39.673020 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3841a9ae-d452-47a4-a7fe-da07fb9f4fd6 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:39.674036 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3841a9ae-d452-47a4-a7fe-da07fb9f4fd6 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:39.688952 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-3841a9ae-d452-47a4-a7fe-da07fb9f4fd6 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] HTTP exception thrown: Instance 32de816e-958f-4d99-a8cf-dc7f5522cf22 could not be found. Aug 01 14:31:39.690500 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3841a9ae-d452-47a4-a7fe-da07fb9f4fd6 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Request method failure captured: Aug 01 14:31:39.690500 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: DELETE /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 HTTP/1.1 Aug 01 14:31:39.690500 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:31:39.690500 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:31:39.690500 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:31:39.690500 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 0 Aug 01 14:31:39.690500 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:31:39.690500 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:31:39.690500 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:31:39.690500 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:31:39.690500 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-K78faWMgu8mzA4Eg8pgsiGxTE6pBXhmPQojigyrNjIMs1R9adp28mi7VvKThaG50jD5wKdwDz7gzAJrj7AtVL0Rk_xR189lfsf40Nm3HxixhapJZjfNBrZScoAKOd8VMLb2ykHjXYrSPq9SiJe7buVp5udlI1E05AGLj0LDk6Nq5Q Aug 01 14:31:39.690500 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:31:39.690500 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:31:39.690500 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:31:39.690500 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:31:39.690500 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:31:39.690500 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:31:39.690500 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: 00a93cc41a184683a1fb82acfa2660a6 Aug 01 14:31:39.690500 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-AttachVolumeTestJSON-69766420 Aug 01 14:31:39.690500 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:31:39.690500 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:31:39.692143 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/00a93cc41a184683a1fb82acfa2660a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/00a93cc41a184683a1fb82acfa2660a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/00a93cc41a184683a1fb82acfa2660a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_00a93cc41a184683a1fb82acfa2660a6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:31:39.692143 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-AttachVolumeTestJSON-69766420 Aug 01 14:31:39.692143 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 00a93cc41a184683a1fb82acfa2660a6 Aug 01 14:31:39.692143 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-AttachVolumeTestJSON-69766420 Aug 01 14:31:39.692143 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-AttachVolumeTestJSON-69766420-project Aug 01 14:31:39.692143 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:31:39.692143 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:31:39.692143 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: 4079529de70f4994ab9f1f3dd5cb3fd7 Aug 01 14:31:39.692143 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-AttachVolumeTestJSON-69766420-project Aug 01 14:31:39.692143 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: > Aug 01 14:31:39.692143 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Instance 32de816e-958f-4d99-a8cf-dc7f5522cf22 could not be found. Aug 01 14:31:39.692143 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'id': '32de816e-958f-4d99-a8cf-dc7f5522cf22'} Aug 01 14:31:39.692949 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:31:39.692949 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:31:39.692949 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:31:39.692949 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:31:39.692949 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:31:39.692949 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:31:39.692949 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:31:39.692949 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:31:39.692949 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:31:39.692949 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:31:39.692949 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32de816e-958f-4d99-a8cf-dc7f5522cf22 could not be found. Aug 01 14:31:39.692949 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:31:39.692949 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:31:39.692949 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:31:39.692949 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:31:39.692949 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:31:39.692949 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:31:39.692949 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:31:39.692949 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:31:39.692949 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:31:39.694604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:31:39.694604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:31:39.694604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:31:39.694604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:31:39.694604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:31:39.694604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:31:39.694604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:31:39.694604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:31:39.694604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:31:39.694604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32de816e-958f-4d99-a8cf-dc7f5522cf22 could not be found. Aug 01 14:31:39.694604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:31:39.694604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:31:39.694604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:31:39.694604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:31:39.694604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:31:39.694604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:31:39.694604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:31:39.694604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:31:39.694604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32de816e-958f-4d99-a8cf-dc7f5522cf22 could not be found. Aug 01 14:31:39.694604 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:31:39.696345 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3841a9ae-d452-47a4-a7fe-da07fb9f4fd6 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Returning 404 to user: Instance 32de816e-958f-4d99-a8cf-dc7f5522cf22 could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:31:39.696345 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3841a9ae-d452-47a4-a7fe-da07fb9f4fd6 tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "DELETE /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 404 len: 111 microversion: 2.1 time: 0.031141 Aug 01 14:31:39.696345 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 578/1167] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Aug 1 14:31:39 2022] DELETE /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:31:39.700414 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-292d3dc1-b2f5-41b6-accf-df25c7569b6b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:39.701009 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-292d3dc1-b2f5-41b6-accf-df25c7569b6b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] [instance: 32de816e-958f-4d99-a8cf-dc7f5522cf22] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:39.707615 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-292d3dc1-b2f5-41b6-accf-df25c7569b6b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:39.708030 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-292d3dc1-b2f5-41b6-accf-df25c7569b6b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:39.708886 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-292d3dc1-b2f5-41b6-accf-df25c7569b6b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:39.709314 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-292d3dc1-b2f5-41b6-accf-df25c7569b6b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:39.722990 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-292d3dc1-b2f5-41b6-accf-df25c7569b6b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] HTTP exception thrown: Instance 32de816e-958f-4d99-a8cf-dc7f5522cf22 could not be found. Aug 01 14:31:39.724498 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-292d3dc1-b2f5-41b6-accf-df25c7569b6b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Request method failure captured: Aug 01 14:31:39.724498 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: request: GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 HTTP/1.1 Aug 01 14:31:39.724498 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept: application/json Aug 01 14:31:39.724498 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Aug 01 14:31:39.724498 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Connection: close Aug 01 14:31:39.724498 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Length: 0 Aug 01 14:31:39.724498 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Type: application/json Aug 01 14:31:39.724498 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Host: 10.222.0.17 Aug 01 14:31:39.724498 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Aug 01 14:31:39.724498 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.10 Aug 01 14:31:39.724498 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABi5-K78faWMgu8mzA4Eg8pgsiGxTE6pBXhmPQojigyrNjIMs1R9adp28mi7VvKThaG50jD5wKdwDz7gzAJrj7AtVL0Rk_xR189lfsf40Nm3HxixhapJZjfNBrZScoAKOd8VMLb2ykHjXYrSPq9SiJe7buVp5udlI1E05AGLj0LDk6Nq5Q Aug 01 14:31:39.724498 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Aug 01 14:31:39.724498 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Aug 01 14:31:39.724498 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Aug 01 14:31:39.724498 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Aug 01 14:31:39.724498 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Aug 01 14:31:39.724498 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Aug 01 14:31:39.724498 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Id: 00a93cc41a184683a1fb82acfa2660a6 Aug 01 14:31:39.724498 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-AttachVolumeTestJSON-69766420 Aug 01 14:31:39.724498 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Role: reader,member Aug 01 14:31:39.724498 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Roles: reader,member Aug 01 14:31:39.726068 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/00a93cc41a184683a1fb82acfa2660a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/00a93cc41a184683a1fb82acfa2660a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/00a93cc41a184683a1fb82acfa2660a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_00a93cc41a184683a1fb82acfa2660a6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:31:39.726068 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-AttachVolumeTestJSON-69766420 Aug 01 14:31:39.726068 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 00a93cc41a184683a1fb82acfa2660a6 Aug 01 14:31:39.726068 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-AttachVolumeTestJSON-69766420 Aug 01 14:31:39.726068 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User: tempest-AttachVolumeTestJSON-69766420-project Aug 01 14:31:39.726068 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Aug 01 14:31:39.726068 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Aug 01 14:31:39.726068 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Id: 4079529de70f4994ab9f1f3dd5cb3fd7 Aug 01 14:31:39.726068 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-AttachVolumeTestJSON-69766420-project Aug 01 14:31:39.726068 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: method: > Aug 01 14:31:39.726068 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: exception: Instance 32de816e-958f-4d99-a8cf-dc7f5522cf22 could not be found. Aug 01 14:31:39.726068 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: action_args: {'id': '32de816e-958f-4d99-a8cf-dc7f5522cf22'} Aug 01 14:31:39.726965 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:31:39.726965 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:31:39.726965 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:31:39.726965 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:31:39.726965 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:31:39.726965 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:31:39.726965 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:31:39.726965 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:31:39.726965 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:31:39.726965 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:31:39.726965 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32de816e-958f-4d99-a8cf-dc7f5522cf22 could not be found. Aug 01 14:31:39.726965 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:31:39.726965 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:31:39.726965 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:31:39.726965 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:31:39.726965 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:31:39.726965 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:31:39.726965 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:31:39.726965 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:31:39.726965 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:31:39.728324 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:31:39.728324 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:31:39.728324 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:31:39.728324 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:31:39.728324 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:31:39.728324 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:31:39.728324 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:31:39.728324 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32de816e-958f-4d99-a8cf-dc7f5522cf22 could not be found. Aug 01 14:31:39.728324 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:31:39.728324 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:31:39.728324 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:31:39.728324 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:31:39.728324 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:31:39.728324 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:31:39.728324 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:31:39.728324 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:31:39.728324 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32de816e-958f-4d99-a8cf-dc7f5522cf22 could not be found. Aug 01 14:31:39.728324 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:31:39.729506 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-292d3dc1-b2f5-41b6-accf-df25c7569b6b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] Returning 404 to user: Instance 32de816e-958f-4d99-a8cf-dc7f5522cf22 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:31:39.729506 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-292d3dc1-b2f5-41b6-accf-df25c7569b6b tempest-AttachVolumeTestJSON-69766420 tempest-AttachVolumeTestJSON-69766420-project] 10.222.0.17 "GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22" status: 404 len: 111 microversion: 2.1 time: 0.029379 Aug 01 14:31:39.729506 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 590/1168] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:39 2022] GET /compute/v2.1/servers/32de816e-958f-4d99-a8cf-dc7f5522cf22 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:32:28.836847 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:32:28.837471 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Mon Aug 1 14:32:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:32:30.491735 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-858b2c11-fc21-4505-b5e9-f3c255ea634a tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1831236341", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-89656764", "security_groups": [{"name": "tempest-secgroup-smoke-107218195"}], "block_device_mapping_v2": [{"uuid": "c78881be-ee11-472a-8798-c6e49fcd78c8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "be2b1497-5181-491f-9b7c-a16c7782ef71"}]}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:32:30.503080 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=37 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:30.503757 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=11 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:30.618678 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.network.neutron [None req-858b2c11-fc21-4505-b5e9-f3c255ea634a tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] validate_networks() for [('be2b1497-5181-491f-9b7c-a16c7782ef71', None, None, None, None, None)] {{(pid=118133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:32:31.013968 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-858b2c11-fc21-4505-b5e9-f3c255ea634a tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Flavor limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:32:31.014391 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-858b2c11-fc21-4505-b5e9-f3c255ea634a tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Image limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:32:31.014867 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-858b2c11-fc21-4505-b5e9-f3c255ea634a tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Flavor pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:32:31.015273 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-858b2c11-fc21-4505-b5e9-f3c255ea634a tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Image pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:32:31.015713 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-858b2c11-fc21-4505-b5e9-f3c255ea634a tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:32:31.024940 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-858b2c11-fc21-4505-b5e9-f3c255ea634a tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:31.025390 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-858b2c11-fc21-4505-b5e9-f3c255ea634a tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:31.026187 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-858b2c11-fc21-4505-b5e9-f3c255ea634a tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:31.026626 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-858b2c11-fc21-4505-b5e9-f3c255ea634a tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:31.043639 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-858b2c11-fc21-4505-b5e9-f3c255ea634a tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Getting quotas for project 47e500c5985743a2a5abfb99c0f42ab7. Resources: {'instances', 'cores', 'ram'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:32:31.047805 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-858b2c11-fc21-4505-b5e9-f3c255ea634a tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Getting quotas for user 540bec8413b144889a07e9d9458b298e and project 47e500c5985743a2a5abfb99c0f42ab7. Resources: {'instances', 'cores', 'ram'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:32:31.113223 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-858b2c11-fc21-4505-b5e9-f3c255ea634a tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Going to run 1 instances... {{(pid=118133) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:32:31.115365 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-858b2c11-fc21-4505-b5e9-f3c255ea634a tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 7e66cde1-dc44-443e-9a06-63d43b1ced37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c78881be-ee11-472a-8798-c6e49fcd78c8',volume_size=None,volume_type=None)] {{(pid=118133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:32:31.270675 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-858b2c11-fc21-4505-b5e9-f3c255ea634a tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.782903 Aug 01 14:32:31.271317 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 579/1169] 10.222.0.17 () {60 vars in 1147 bytes} [Mon Aug 1 14:32:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:32:31.282241 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b53e1c7c-30ce-4e61-8ee7-a9007b24b2ff tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:31.282840 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b53e1c7c-30ce-4e61-8ee7-a9007b24b2ff tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 7e66cde1-dc44-443e-9a06-63d43b1ced37] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:31.285614 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:31.286252 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:31.356965 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b53e1c7c-30ce-4e61-8ee7-a9007b24b2ff tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:31.364376 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b53e1c7c-30ce-4e61-8ee7-a9007b24b2ff tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37" status: 200 len: 1093 microversion: 2.1 time: 0.086057 Aug 01 14:32:31.364949 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 591/1170] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:31 2022] GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37 => generated 1093 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:32.385959 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-315f5ab7-b3c4-4460-a497-04b14820bc5d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:32.386749 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-315f5ab7-b3c4-4460-a497-04b14820bc5d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 7e66cde1-dc44-443e-9a06-63d43b1ced37] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:32.394423 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-315f5ab7-b3c4-4460-a497-04b14820bc5d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:32.394877 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-315f5ab7-b3c4-4460-a497-04b14820bc5d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:32.395723 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-315f5ab7-b3c4-4460-a497-04b14820bc5d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:32.396150 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-315f5ab7-b3c4-4460-a497-04b14820bc5d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:32.469798 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-315f5ab7-b3c4-4460-a497-04b14820bc5d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:32.478577 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-315f5ab7-b3c4-4460-a497-04b14820bc5d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37" status: 200 len: 1199 microversion: 2.1 time: 0.096889 Aug 01 14:32:32.479535 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 580/1171] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:32 2022] GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37 => generated 1199 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:33.501415 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-44c31b6c-58be-41e8-b829-4d514a1364b3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:33.502027 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-44c31b6c-58be-41e8-b829-4d514a1364b3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 7e66cde1-dc44-443e-9a06-63d43b1ced37] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:33.510804 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-44c31b6c-58be-41e8-b829-4d514a1364b3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:33.511255 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-44c31b6c-58be-41e8-b829-4d514a1364b3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:33.512056 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-44c31b6c-58be-41e8-b829-4d514a1364b3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:33.512517 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-44c31b6c-58be-41e8-b829-4d514a1364b3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:33.730476 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-44c31b6c-58be-41e8-b829-4d514a1364b3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:33.739314 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-44c31b6c-58be-41e8-b829-4d514a1364b3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37" status: 200 len: 1264 microversion: 2.1 time: 0.241988 Aug 01 14:32:33.739932 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 592/1172] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:33 2022] GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37 => generated 1264 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:33.993237 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-17d8e7fa-4ec9-4b09-908a-cdc805e746ad req-7f008272-d357-4647-baf3-ad82a2c4fd81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e66cde1-dc44-443e-9a06-63d43b1ced37", "tag": "d16e532d-680c-4843-984e-9214fd490019"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:32:34.007905 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-17d8e7fa-4ec9-4b09-908a-cdc805e746ad req-7f008272-d357-4647-baf3-ad82a2c4fd81 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:34.008449 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-17d8e7fa-4ec9-4b09-908a-cdc805e746ad req-7f008272-d357-4647-baf3-ad82a2c4fd81 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:34.020821 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-17d8e7fa-4ec9-4b09-908a-cdc805e746ad req-7f008272-d357-4647-baf3-ad82a2c4fd81 service nova] Creating event network-changed:d16e532d-680c-4843-984e-9214fd490019 for instance 7e66cde1-dc44-443e-9a06-63d43b1ced37 on hv-cinder-84599 Aug 01 14:32:34.026671 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-17d8e7fa-4ec9-4b09-908a-cdc805e746ad req-7f008272-d357-4647-baf3-ad82a2c4fd81 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037858 Aug 01 14:32:34.027545 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 581/1173] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:32:34.761370 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b1dc5205-40fd-4b79-98fa-beff82bb43bc tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:34.761980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b1dc5205-40fd-4b79-98fa-beff82bb43bc tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 7e66cde1-dc44-443e-9a06-63d43b1ced37] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:34.769154 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b1dc5205-40fd-4b79-98fa-beff82bb43bc tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:34.769592 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b1dc5205-40fd-4b79-98fa-beff82bb43bc tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:34.770356 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b1dc5205-40fd-4b79-98fa-beff82bb43bc tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:34.770783 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b1dc5205-40fd-4b79-98fa-beff82bb43bc tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:34.945415 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-b1dc5205-40fd-4b79-98fa-beff82bb43bc tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:34.953198 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b1dc5205-40fd-4b79-98fa-beff82bb43bc tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37" status: 200 len: 1264 microversion: 2.1 time: 0.195707 Aug 01 14:32:34.953784 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 593/1174] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:34 2022] GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37 => generated 1264 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:35.977168 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6fe5cbd0-b441-4564-a31f-212fd74ea192 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:35.977779 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-6fe5cbd0-b441-4564-a31f-212fd74ea192 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 7e66cde1-dc44-443e-9a06-63d43b1ced37] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:35.985345 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6fe5cbd0-b441-4564-a31f-212fd74ea192 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:35.985824 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6fe5cbd0-b441-4564-a31f-212fd74ea192 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:35.986603 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6fe5cbd0-b441-4564-a31f-212fd74ea192 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:35.987099 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6fe5cbd0-b441-4564-a31f-212fd74ea192 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:36.128301 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6fe5cbd0-b441-4564-a31f-212fd74ea192 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:36.136029 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6fe5cbd0-b441-4564-a31f-212fd74ea192 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37" status: 200 len: 1264 microversion: 2.1 time: 0.164948 Aug 01 14:32:36.136612 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 582/1175] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:35 2022] GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:37.156961 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-552cbbe5-8122-4ff9-a41e-9dcd4e8e0e57 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:37.157614 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-552cbbe5-8122-4ff9-a41e-9dcd4e8e0e57 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 7e66cde1-dc44-443e-9a06-63d43b1ced37] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:37.164387 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-552cbbe5-8122-4ff9-a41e-9dcd4e8e0e57 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:37.164833 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-552cbbe5-8122-4ff9-a41e-9dcd4e8e0e57 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:37.165601 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-552cbbe5-8122-4ff9-a41e-9dcd4e8e0e57 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:37.166025 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-552cbbe5-8122-4ff9-a41e-9dcd4e8e0e57 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:37.311124 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-552cbbe5-8122-4ff9-a41e-9dcd4e8e0e57 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:37.319497 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-552cbbe5-8122-4ff9-a41e-9dcd4e8e0e57 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37" status: 200 len: 1264 microversion: 2.1 time: 0.166293 Aug 01 14:32:37.320077 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 594/1176] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:37 2022] GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:38.341259 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-dc7a8f88-4feb-49c8-86a3-ebd555a91682 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:38.341856 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-dc7a8f88-4feb-49c8-86a3-ebd555a91682 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 7e66cde1-dc44-443e-9a06-63d43b1ced37] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:38.349041 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dc7a8f88-4feb-49c8-86a3-ebd555a91682 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:38.349487 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dc7a8f88-4feb-49c8-86a3-ebd555a91682 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:38.350250 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dc7a8f88-4feb-49c8-86a3-ebd555a91682 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:38.350685 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dc7a8f88-4feb-49c8-86a3-ebd555a91682 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:38.480471 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-dc7a8f88-4feb-49c8-86a3-ebd555a91682 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:38.488290 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-dc7a8f88-4feb-49c8-86a3-ebd555a91682 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37" status: 200 len: 1264 microversion: 2.1 time: 0.150987 Aug 01 14:32:38.488859 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 583/1177] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:38 2022] GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:39.509072 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e2a5aaf4-176e-41d2-92a1-030e6848ce85 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:39.509703 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e2a5aaf4-176e-41d2-92a1-030e6848ce85 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 7e66cde1-dc44-443e-9a06-63d43b1ced37] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:39.516019 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e2a5aaf4-176e-41d2-92a1-030e6848ce85 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:39.516471 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e2a5aaf4-176e-41d2-92a1-030e6848ce85 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:39.517250 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e2a5aaf4-176e-41d2-92a1-030e6848ce85 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:39.517685 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e2a5aaf4-176e-41d2-92a1-030e6848ce85 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:39.655691 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-e2a5aaf4-176e-41d2-92a1-030e6848ce85 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:39.663881 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e2a5aaf4-176e-41d2-92a1-030e6848ce85 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37" status: 200 len: 1264 microversion: 2.1 time: 0.158677 Aug 01 14:32:39.664448 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 595/1178] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:39 2022] GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:40.687082 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-cd16d27f-ee48-49b8-9478-2b6508273e8e tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:40.687727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-cd16d27f-ee48-49b8-9478-2b6508273e8e tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 7e66cde1-dc44-443e-9a06-63d43b1ced37] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:40.695761 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cd16d27f-ee48-49b8-9478-2b6508273e8e tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:40.696215 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cd16d27f-ee48-49b8-9478-2b6508273e8e tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:40.696981 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cd16d27f-ee48-49b8-9478-2b6508273e8e tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:40.697408 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cd16d27f-ee48-49b8-9478-2b6508273e8e tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:40.844496 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-cd16d27f-ee48-49b8-9478-2b6508273e8e tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:40.852712 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-cd16d27f-ee48-49b8-9478-2b6508273e8e tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37" status: 200 len: 1264 microversion: 2.1 time: 0.170542 Aug 01 14:32:40.853286 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 584/1179] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:40 2022] GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:41.874506 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-29ee26da-b1e2-4e88-ba27-f64947bd7c89 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:41.875091 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-29ee26da-b1e2-4e88-ba27-f64947bd7c89 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 7e66cde1-dc44-443e-9a06-63d43b1ced37] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:41.877515 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell0:SELECT=2 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:41.883917 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-29ee26da-b1e2-4e88-ba27-f64947bd7c89 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:41.884359 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-29ee26da-b1e2-4e88-ba27-f64947bd7c89 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:41.885125 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-29ee26da-b1e2-4e88-ba27-f64947bd7c89 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:41.885559 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-29ee26da-b1e2-4e88-ba27-f64947bd7c89 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:42.030653 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-29ee26da-b1e2-4e88-ba27-f64947bd7c89 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:42.040048 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-29ee26da-b1e2-4e88-ba27-f64947bd7c89 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37" status: 200 len: 1264 microversion: 2.1 time: 0.169414 Aug 01 14:32:42.040632 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 596/1180] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:41 2022] GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:43.061359 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b63546b3-0de5-4441-b7f1-5c696761eb08 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:43.062028 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b63546b3-0de5-4441-b7f1-5c696761eb08 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 7e66cde1-dc44-443e-9a06-63d43b1ced37] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:43.064122 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:43.064792 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=6 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:43.071966 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b63546b3-0de5-4441-b7f1-5c696761eb08 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:43.072415 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b63546b3-0de5-4441-b7f1-5c696761eb08 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:43.073196 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b63546b3-0de5-4441-b7f1-5c696761eb08 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:43.073639 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b63546b3-0de5-4441-b7f1-5c696761eb08 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:43.222754 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b63546b3-0de5-4441-b7f1-5c696761eb08 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:43.230310 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b63546b3-0de5-4441-b7f1-5c696761eb08 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37" status: 200 len: 1264 microversion: 2.1 time: 0.172841 Aug 01 14:32:43.230881 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 585/1181] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:43 2022] GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:44.251367 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-1ef9f482-1ee2-4b71-bc44-b5efbdf12259 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:44.252000 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-1ef9f482-1ee2-4b71-bc44-b5efbdf12259 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 7e66cde1-dc44-443e-9a06-63d43b1ced37] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:44.259020 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1ef9f482-1ee2-4b71-bc44-b5efbdf12259 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:44.259479 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1ef9f482-1ee2-4b71-bc44-b5efbdf12259 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:44.260254 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1ef9f482-1ee2-4b71-bc44-b5efbdf12259 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:44.260682 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-1ef9f482-1ee2-4b71-bc44-b5efbdf12259 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:44.402131 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-1ef9f482-1ee2-4b71-bc44-b5efbdf12259 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:44.409861 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-1ef9f482-1ee2-4b71-bc44-b5efbdf12259 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37" status: 200 len: 1264 microversion: 2.1 time: 0.162292 Aug 01 14:32:44.410440 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 597/1182] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:44 2022] GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:45.431768 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d9be3e30-b16a-4866-ae5b-33862d4a0a1c tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:45.432416 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d9be3e30-b16a-4866-ae5b-33862d4a0a1c tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 7e66cde1-dc44-443e-9a06-63d43b1ced37] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:45.439023 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d9be3e30-b16a-4866-ae5b-33862d4a0a1c tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:45.439489 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d9be3e30-b16a-4866-ae5b-33862d4a0a1c tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:45.440260 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d9be3e30-b16a-4866-ae5b-33862d4a0a1c tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:45.440683 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d9be3e30-b16a-4866-ae5b-33862d4a0a1c tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:45.550497 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-73742306-eca6-43e4-b364-fa47aeb77e25 req-e3b915ed-5a98-48e1-b2fc-dcbf98a708b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e66cde1-dc44-443e-9a06-63d43b1ced37", "name": "network-vif-plugged", "status": "completed", "tag": "d16e532d-680c-4843-984e-9214fd490019"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:32:45.565278 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-73742306-eca6-43e4-b364-fa47aeb77e25 req-e3b915ed-5a98-48e1-b2fc-dcbf98a708b2 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:45.565714 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-73742306-eca6-43e4-b364-fa47aeb77e25 req-e3b915ed-5a98-48e1-b2fc-dcbf98a708b2 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:45.577821 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-73742306-eca6-43e4-b364-fa47aeb77e25 req-e3b915ed-5a98-48e1-b2fc-dcbf98a708b2 service nova] Creating event network-vif-plugged:d16e532d-680c-4843-984e-9214fd490019 for instance 7e66cde1-dc44-443e-9a06-63d43b1ced37 on hv-cinder-84599 Aug 01 14:32:45.584422 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-73742306-eca6-43e4-b364-fa47aeb77e25 req-e3b915ed-5a98-48e1-b2fc-dcbf98a708b2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037581 Aug 01 14:32:45.585392 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 598/1183] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:32:45.597616 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d9be3e30-b16a-4866-ae5b-33862d4a0a1c tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:45.606347 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d9be3e30-b16a-4866-ae5b-33862d4a0a1c tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37" status: 200 len: 1264 microversion: 2.1 time: 0.178943 Aug 01 14:32:45.606928 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 586/1184] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:45 2022] GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:46.631645 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-a482b194-5db8-4db2-bddc-fad557f5ffc4 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:46.632351 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-a482b194-5db8-4db2-bddc-fad557f5ffc4 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 7e66cde1-dc44-443e-9a06-63d43b1ced37] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:46.639312 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a482b194-5db8-4db2-bddc-fad557f5ffc4 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:46.639793 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a482b194-5db8-4db2-bddc-fad557f5ffc4 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:46.640587 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a482b194-5db8-4db2-bddc-fad557f5ffc4 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:46.641020 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-a482b194-5db8-4db2-bddc-fad557f5ffc4 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:46.787134 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-a482b194-5db8-4db2-bddc-fad557f5ffc4 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:46.794892 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-a482b194-5db8-4db2-bddc-fad557f5ffc4 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37" status: 200 len: 1264 microversion: 2.1 time: 0.168806 Aug 01 14:32:46.795478 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 599/1185] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:46 2022] GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:47.815723 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-531368f5-56e2-4d96-8f46-9cc7c01a6d8d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:47.816330 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-531368f5-56e2-4d96-8f46-9cc7c01a6d8d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 7e66cde1-dc44-443e-9a06-63d43b1ced37] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:47.823012 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-531368f5-56e2-4d96-8f46-9cc7c01a6d8d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:47.823480 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-531368f5-56e2-4d96-8f46-9cc7c01a6d8d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:47.824263 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-531368f5-56e2-4d96-8f46-9cc7c01a6d8d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:47.824696 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-531368f5-56e2-4d96-8f46-9cc7c01a6d8d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:47.958954 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-531368f5-56e2-4d96-8f46-9cc7c01a6d8d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:47.967260 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-531368f5-56e2-4d96-8f46-9cc7c01a6d8d tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37" status: 200 len: 1451 microversion: 2.1 time: 0.155440 Aug 01 14:32:47.967876 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 587/1186] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:47 2022] GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:47.993848 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-16899d9b-a6d9-487d-a452-ae7187d9e151 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:47.994700 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-16899d9b-a6d9-487d-a452-ae7187d9e151 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 7e66cde1-dc44-443e-9a06-63d43b1ced37] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:48.001086 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-16899d9b-a6d9-487d-a452-ae7187d9e151 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:48.001539 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-16899d9b-a6d9-487d-a452-ae7187d9e151 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:48.002308 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-16899d9b-a6d9-487d-a452-ae7187d9e151 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:48.002742 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-16899d9b-a6d9-487d-a452-ae7187d9e151 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:48.143696 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-16899d9b-a6d9-487d-a452-ae7187d9e151 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:48.151918 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-16899d9b-a6d9-487d-a452-ae7187d9e151 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37" status: 200 len: 1451 microversion: 2.1 time: 0.161906 Aug 01 14:32:48.152581 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 600/1187] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:47 2022] GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:49.924505 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-95223dc0-c3e1-4f59-bb0a-03c79514eb9a req-8f463f27-d96b-4488-8233-f5457e964e72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e66cde1-dc44-443e-9a06-63d43b1ced37", "tag": "d16e532d-680c-4843-984e-9214fd490019"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:32:49.935441 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-95223dc0-c3e1-4f59-bb0a-03c79514eb9a req-8f463f27-d96b-4488-8233-f5457e964e72 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:49.935918 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-95223dc0-c3e1-4f59-bb0a-03c79514eb9a req-8f463f27-d96b-4488-8233-f5457e964e72 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:49.956649 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-95223dc0-c3e1-4f59-bb0a-03c79514eb9a req-8f463f27-d96b-4488-8233-f5457e964e72 service nova] Creating event network-changed:d16e532d-680c-4843-984e-9214fd490019 for instance 7e66cde1-dc44-443e-9a06-63d43b1ced37 on hv-cinder-84599 Aug 01 14:32:49.962602 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-95223dc0-c3e1-4f59-bb0a-03c79514eb9a req-8f463f27-d96b-4488-8233-f5457e964e72 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041577 Aug 01 14:32:49.963401 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 588/1188] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:32:51.495620 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-61ae9797-388e-4638-9275-a19939c39a1b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:51.496159 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-61ae9797-388e-4638-9275-a19939c39a1b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:51.502711 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-61ae9797-388e-4638-9275-a19939c39a1b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:51.503163 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-61ae9797-388e-4638-9275-a19939c39a1b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:51.503979 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-61ae9797-388e-4638-9275-a19939c39a1b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:51.504412 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-61ae9797-388e-4638-9275-a19939c39a1b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:51.530141 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-61ae9797-388e-4638-9275-a19939c39a1b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Going to try to terminate instance {{(pid=118132) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:32:51.620505 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-61ae9797-388e-4638-9275-a19939c39a1b tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 204 len: 0 microversion: 2.1 time: 0.128928 Aug 01 14:32:51.625478 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 601/1189] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Aug 1 14:32:51 2022] DELETE /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:32:51.633602 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-401414e9-92fe-494e-a1df-323c7b32fade tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:51.634302 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-401414e9-92fe-494e-a1df-323c7b32fade tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:51.641125 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-401414e9-92fe-494e-a1df-323c7b32fade tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:51.641610 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-401414e9-92fe-494e-a1df-323c7b32fade tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:51.642385 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-401414e9-92fe-494e-a1df-323c7b32fade tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:51.642991 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-401414e9-92fe-494e-a1df-323c7b32fade tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:51.811883 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-401414e9-92fe-494e-a1df-323c7b32fade tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:51.821885 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-401414e9-92fe-494e-a1df-323c7b32fade tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1569 microversion: 2.1 time: 0.194503 Aug 01 14:32:51.822484 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 589/1190] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:51 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1569 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:52.004960 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-1a291005-5436-4e42-ab3c-a07fcd36b940 req-e85f8ae9-e83d-47e8-b11b-4febd262573a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e51815a-0d9e-494f-8960-a75433080b70", "tag": "4bdcf192-f56a-4ae6-a4bb-17090119b4d9"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:32:52.015962 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-1a291005-5436-4e42-ab3c-a07fcd36b940 req-e85f8ae9-e83d-47e8-b11b-4febd262573a service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:52.016402 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-1a291005-5436-4e42-ab3c-a07fcd36b940 req-e85f8ae9-e83d-47e8-b11b-4febd262573a service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:52.029359 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-1a291005-5436-4e42-ab3c-a07fcd36b940 req-e85f8ae9-e83d-47e8-b11b-4febd262573a service nova] Creating event network-changed:4bdcf192-f56a-4ae6-a4bb-17090119b4d9 for instance 3e51815a-0d9e-494f-8960-a75433080b70 on hv-cinder-84599 Aug 01 14:32:52.035016 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-1a291005-5436-4e42-ab3c-a07fcd36b940 req-e85f8ae9-e83d-47e8-b11b-4febd262573a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033946 Aug 01 14:32:52.035659 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 602/1191] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:32:52.844427 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-996caae7-4175-4eb2-a107-43f69c224bad tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:52.845078 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-996caae7-4175-4eb2-a107-43f69c224bad tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:52.852446 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-996caae7-4175-4eb2-a107-43f69c224bad tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:52.852899 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-996caae7-4175-4eb2-a107-43f69c224bad tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:52.853716 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-996caae7-4175-4eb2-a107-43f69c224bad tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:52.854156 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-996caae7-4175-4eb2-a107-43f69c224bad tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:53.008994 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-996caae7-4175-4eb2-a107-43f69c224bad tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:53.016941 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-996caae7-4175-4eb2-a107-43f69c224bad tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1569 microversion: 2.1 time: 0.176452 Aug 01 14:32:53.017531 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 590/1192] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:52 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:32:54.042444 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-48cf58f8-079e-40ee-953b-793d58656704 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:54.043408 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-48cf58f8-079e-40ee-953b-793d58656704 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:54.049689 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-a3f47d39-1faf-4e9e-a8be-950ac046e833 req-516d7b4d-8077-472b-9101-45a206621823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e51815a-0d9e-494f-8960-a75433080b70", "name": "network-vif-deleted", "tag": "4bdcf192-f56a-4ae6-a4bb-17090119b4d9"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:32:54.050378 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-48cf58f8-079e-40ee-953b-793d58656704 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:54.050688 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-48cf58f8-079e-40ee-953b-793d58656704 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:54.051876 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-48cf58f8-079e-40ee-953b-793d58656704 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:54.052257 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-48cf58f8-079e-40ee-953b-793d58656704 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:54.062835 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-a3f47d39-1faf-4e9e-a8be-950ac046e833 req-516d7b4d-8077-472b-9101-45a206621823 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:54.063275 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-a3f47d39-1faf-4e9e-a8be-950ac046e833 req-516d7b4d-8077-472b-9101-45a206621823 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:54.076606 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-a3f47d39-1faf-4e9e-a8be-950ac046e833 req-516d7b4d-8077-472b-9101-45a206621823 service nova] Creating event network-vif-deleted:4bdcf192-f56a-4ae6-a4bb-17090119b4d9 for instance 3e51815a-0d9e-494f-8960-a75433080b70 on hv-cinder-84599 Aug 01 14:32:54.082553 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-a3f47d39-1faf-4e9e-a8be-950ac046e833 req-516d7b4d-8077-472b-9101-45a206621823 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036824 Aug 01 14:32:54.083143 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 591/1193] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:32:54.124547 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-48cf58f8-079e-40ee-953b-793d58656704 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6040773eefe146a0adbc7858c7371cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6eb59bc9a445cc9f5b4d3059fbb7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:54.132927 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-48cf58f8-079e-40ee-953b-793d58656704 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 200 len: 1383 microversion: 2.1 time: 0.095264 Aug 01 14:32:54.133508 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 603/1194] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:54 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 1383 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:55.155489 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-45e97c49-ff25-410a-bce3-cc2c239bfd91 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:55.156210 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-45e97c49-ff25-410a-bce3-cc2c239bfd91 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] [instance: 3e51815a-0d9e-494f-8960-a75433080b70] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:55.162727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-45e97c49-ff25-410a-bce3-cc2c239bfd91 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:55.163177 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-45e97c49-ff25-410a-bce3-cc2c239bfd91 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:55.164002 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-45e97c49-ff25-410a-bce3-cc2c239bfd91 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:55.164440 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-45e97c49-ff25-410a-bce3-cc2c239bfd91 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:55.178147 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-45e97c49-ff25-410a-bce3-cc2c239bfd91 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] HTTP exception thrown: Instance 3e51815a-0d9e-494f-8960-a75433080b70 could not be found. Aug 01 14:32:55.179855 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-45e97c49-ff25-410a-bce3-cc2c239bfd91 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Request method failure captured: Aug 01 14:32:55.179855 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 HTTP/1.1 Aug 01 14:32:55.179855 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:32:55.179855 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:32:55.179855 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:32:55.179855 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 0 Aug 01 14:32:55.179855 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:32:55.179855 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:32:55.179855 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:32:55.179855 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:32:55.179855 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-MA3X_qlxmC8BkGOJIAdW0hLemamKDKSGmytQ8Gb-LVMlW7uNFjO1JQNPS1hEryd0Kvde7E9QKC5xc1YuVjdkxoqZ0rNz36cSmaF-vpKll2fP6JMywMrVqehqALGaNHffublwbJqWQsR0WBu-IoU5WKvdIRBYhIqKDgUgMfa9uSBKE Aug 01 14:32:55.179855 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:32:55.179855 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:32:55.179855 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:32:55.179855 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:32:55.179855 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:32:55.179855 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:32:55.179855 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: 2a6eb59bc9a445cc9f5b4d3059fbb7f1 Aug 01 14:32:55.179855 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-TestShelveInstance-2023779780 Aug 01 14:32:55.179855 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:32:55.179855 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:32:55.181669 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a6eb59bc9a445cc9f5b4d3059fbb7f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2a6eb59bc9a445cc9f5b4d3059fbb7f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a6eb59bc9a445cc9f5b4d3059fbb7f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2a6eb59bc9a445cc9f5b4d3059fbb7f1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:32:55.181669 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-TestShelveInstance-2023779780 Aug 01 14:32:55.181669 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 2a6eb59bc9a445cc9f5b4d3059fbb7f1 Aug 01 14:32:55.181669 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-TestShelveInstance-2023779780 Aug 01 14:32:55.181669 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-TestShelveInstance-2023779780-project Aug 01 14:32:55.181669 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:32:55.181669 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:32:55.181669 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: 6040773eefe146a0adbc7858c7371cb8 Aug 01 14:32:55.181669 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-TestShelveInstance-2023779780-project Aug 01 14:32:55.181669 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: > Aug 01 14:32:55.181669 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Instance 3e51815a-0d9e-494f-8960-a75433080b70 could not be found. Aug 01 14:32:55.181669 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'id': '3e51815a-0d9e-494f-8960-a75433080b70'} Aug 01 14:32:55.182766 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:32:55.182766 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:32:55.182766 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:32:55.182766 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:32:55.182766 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:32:55.182766 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:32:55.182766 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:32:55.182766 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:32:55.182766 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:32:55.182766 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:32:55.182766 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e51815a-0d9e-494f-8960-a75433080b70 could not be found. Aug 01 14:32:55.182766 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:32:55.182766 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:32:55.182766 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:32:55.182766 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:32:55.182766 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:32:55.182766 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:32:55.182766 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:32:55.182766 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:32:55.182766 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:32:55.184389 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:32:55.184389 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:32:55.184389 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:32:55.184389 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:32:55.184389 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:32:55.184389 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:32:55.184389 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:32:55.184389 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e51815a-0d9e-494f-8960-a75433080b70 could not be found. Aug 01 14:32:55.184389 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:32:55.184389 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:32:55.184389 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:32:55.184389 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:32:55.184389 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:32:55.184389 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:32:55.184389 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:32:55.184389 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:32:55.184389 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e51815a-0d9e-494f-8960-a75433080b70 could not be found. Aug 01 14:32:55.184389 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:32:55.186072 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-45e97c49-ff25-410a-bce3-cc2c239bfd91 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Returning 404 to user: Instance 3e51815a-0d9e-494f-8960-a75433080b70 could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:32:55.186072 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-45e97c49-ff25-410a-bce3-cc2c239bfd91 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70" status: 404 len: 111 microversion: 2.1 time: 0.030548 Aug 01 14:32:55.186072 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 592/1195] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:55 2022] GET /compute/v2.1/servers/3e51815a-0d9e-494f-8960-a75433080b70 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:32:55.369518 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-8fe6abc8-9ece-4e80-9cc8-5e1c123ff560 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] Calling method '.version_select at 0x7f618584d160>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:55.390901 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-8fe6abc8-9ece-4e80-9cc8-5e1c123ff560 tempest-TestShelveInstance-2023779780 tempest-TestShelveInstance-2023779780-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1940015835" status: 202 len: 0 microversion: 2.1 time: 0.025425 Aug 01 14:32:55.391676 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 604/1196] 10.222.0.17 () {58 vars in 1254 bytes} [Mon Aug 1 14:32:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1940015835 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:33:50.863417 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:33:50.864263 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Mon Aug 1 14:33:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:34:21.268239 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:21.268985 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=64 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:21.270960 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:21.271868 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG dbcounter [-] [118132] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:21.273262 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-48c20204-dab7-4977-b1de-87cee966fdec tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:34:21.274035 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-48c20204-dab7-4977-b1de-87cee966fdec tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 7e66cde1-dc44-443e-9a06-63d43b1ced37] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:34:21.276344 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-feb83f8e-0048-48df-9da4-7d521fc811ba req-2f0b9f60-951f-41f6-970a-67209e154a61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e66cde1-dc44-443e-9a06-63d43b1ced37", "tag": "d16e532d-680c-4843-984e-9214fd490019"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:34:21.285137 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-48c20204-dab7-4977-b1de-87cee966fdec tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:21.286174 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-48c20204-dab7-4977-b1de-87cee966fdec tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:21.286921 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-48c20204-dab7-4977-b1de-87cee966fdec tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:21.287352 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-48c20204-dab7-4977-b1de-87cee966fdec tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:21.287869 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-feb83f8e-0048-48df-9da4-7d521fc811ba req-2f0b9f60-951f-41f6-970a-67209e154a61 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:21.288313 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-feb83f8e-0048-48df-9da4-7d521fc811ba req-2f0b9f60-951f-41f6-970a-67209e154a61 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:21.300530 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-feb83f8e-0048-48df-9da4-7d521fc811ba req-2f0b9f60-951f-41f6-970a-67209e154a61 service nova] Creating event network-changed:d16e532d-680c-4843-984e-9214fd490019 for instance 7e66cde1-dc44-443e-9a06-63d43b1ced37 on hv-cinder-84599 Aug 01 14:34:21.307634 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-feb83f8e-0048-48df-9da4-7d521fc811ba req-2f0b9f60-951f-41f6-970a-67209e154a61 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038450 Aug 01 14:34:21.308516 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 605/1197] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:34:21.321395 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-48c20204-dab7-4977-b1de-87cee966fdec tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 7e66cde1-dc44-443e-9a06-63d43b1ced37] Going to try to terminate instance {{(pid=118133) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:34:21.404843 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-48c20204-dab7-4977-b1de-87cee966fdec tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37" status: 204 len: 0 microversion: 2.1 time: 0.138134 Aug 01 14:34:21.406054 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 593/1198] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Aug 1 14:34:21 2022] DELETE /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:34:21.415801 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f44f1e78-5e5b-4711-bbb5-db240a50daf3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:34:21.416510 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f44f1e78-5e5b-4711-bbb5-db240a50daf3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 7e66cde1-dc44-443e-9a06-63d43b1ced37] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:34:21.423787 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f44f1e78-5e5b-4711-bbb5-db240a50daf3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:21.424232 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f44f1e78-5e5b-4711-bbb5-db240a50daf3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:21.424999 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f44f1e78-5e5b-4711-bbb5-db240a50daf3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:21.425437 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f44f1e78-5e5b-4711-bbb5-db240a50daf3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:21.565623 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f44f1e78-5e5b-4711-bbb5-db240a50daf3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:34:21.574913 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f44f1e78-5e5b-4711-bbb5-db240a50daf3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37" status: 200 len: 1576 microversion: 2.1 time: 0.163734 Aug 01 14:34:21.575513 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 606/1199] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:34:21 2022] GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:34:22.597185 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-4311e800-73d8-4332-a70a-10dcf596b029 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:34:22.597797 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-4311e800-73d8-4332-a70a-10dcf596b029 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 7e66cde1-dc44-443e-9a06-63d43b1ced37] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:34:22.604454 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4311e800-73d8-4332-a70a-10dcf596b029 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:22.604909 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4311e800-73d8-4332-a70a-10dcf596b029 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:22.605683 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4311e800-73d8-4332-a70a-10dcf596b029 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:22.606124 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4311e800-73d8-4332-a70a-10dcf596b029 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:22.745897 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4311e800-73d8-4332-a70a-10dcf596b029 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:34:22.753708 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-4311e800-73d8-4332-a70a-10dcf596b029 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37" status: 200 len: 1576 microversion: 2.1 time: 0.160850 Aug 01 14:34:22.754280 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 594/1200] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:34:22 2022] GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:34:23.776360 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-139bfe13-6d7d-4ec3-8676-6918d056bc68 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:34:23.777117 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-139bfe13-6d7d-4ec3-8676-6918d056bc68 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 7e66cde1-dc44-443e-9a06-63d43b1ced37] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:34:23.783947 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-139bfe13-6d7d-4ec3-8676-6918d056bc68 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:23.784385 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-139bfe13-6d7d-4ec3-8676-6918d056bc68 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:23.785184 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-139bfe13-6d7d-4ec3-8676-6918d056bc68 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:23.785614 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-139bfe13-6d7d-4ec3-8676-6918d056bc68 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:23.875833 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-139bfe13-6d7d-4ec3-8676-6918d056bc68 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:34:23.883980 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-139bfe13-6d7d-4ec3-8676-6918d056bc68 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37" status: 200 len: 1390 microversion: 2.1 time: 0.112215 Aug 01 14:34:23.884809 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 607/1201] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:34:23 2022] GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37 => generated 1390 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:34:23.941448 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-9c29d787-91f6-4251-9fc1-3819dbdbf027 req-cafb32d4-a103-4f69-b95a-2da4b7ec1bda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e66cde1-dc44-443e-9a06-63d43b1ced37", "name": "network-vif-deleted", "tag": "d16e532d-680c-4843-984e-9214fd490019"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:34:23.952382 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-9c29d787-91f6-4251-9fc1-3819dbdbf027 req-cafb32d4-a103-4f69-b95a-2da4b7ec1bda service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:23.952826 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-9c29d787-91f6-4251-9fc1-3819dbdbf027 req-cafb32d4-a103-4f69-b95a-2da4b7ec1bda service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:23.964670 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-9c29d787-91f6-4251-9fc1-3819dbdbf027 req-cafb32d4-a103-4f69-b95a-2da4b7ec1bda service nova] Creating event network-vif-deleted:d16e532d-680c-4843-984e-9214fd490019 for instance 7e66cde1-dc44-443e-9a06-63d43b1ced37 on hv-cinder-84599 Aug 01 14:34:23.970272 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-9c29d787-91f6-4251-9fc1-3819dbdbf027 req-cafb32d4-a103-4f69-b95a-2da4b7ec1bda service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033058 Aug 01 14:34:23.970988 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 595/1202] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:34:24.910707 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-0842d4d0-65b5-4d1b-bb48-4a80149097b8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:34:24.911256 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-0842d4d0-65b5-4d1b-bb48-4a80149097b8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 7e66cde1-dc44-443e-9a06-63d43b1ced37] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:34:24.918781 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0842d4d0-65b5-4d1b-bb48-4a80149097b8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:24.919357 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0842d4d0-65b5-4d1b-bb48-4a80149097b8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:24.920303 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0842d4d0-65b5-4d1b-bb48-4a80149097b8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:24.920742 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0842d4d0-65b5-4d1b-bb48-4a80149097b8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:24.953867 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0842d4d0-65b5-4d1b-bb48-4a80149097b8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:24.954306 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-0842d4d0-65b5-4d1b-bb48-4a80149097b8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:24.954747 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.objects.instance [None req-0842d4d0-65b5-4d1b-bb48-4a80149097b8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lazy-loading 'fault' on Instance uuid 7e66cde1-dc44-443e-9a06-63d43b1ced37 {{(pid=118132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:34:25.000036 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-0842d4d0-65b5-4d1b-bb48-4a80149097b8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:34:25.006795 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-0842d4d0-65b5-4d1b-bb48-4a80149097b8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37" status: 200 len: 1183 microversion: 2.1 time: 0.100402 Aug 01 14:34:25.007356 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 608/1203] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:34:24 2022] GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37 => generated 1183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:34:26.029310 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-41adf344-2799-4881-b366-a6c28bf9b58f tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:34:26.030042 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-41adf344-2799-4881-b366-a6c28bf9b58f tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 7e66cde1-dc44-443e-9a06-63d43b1ced37] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:34:26.036484 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-41adf344-2799-4881-b366-a6c28bf9b58f tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:26.036970 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-41adf344-2799-4881-b366-a6c28bf9b58f tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:26.037760 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-41adf344-2799-4881-b366-a6c28bf9b58f tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:26.038194 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-41adf344-2799-4881-b366-a6c28bf9b58f tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:26.052527 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-41adf344-2799-4881-b366-a6c28bf9b58f tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] HTTP exception thrown: Instance 7e66cde1-dc44-443e-9a06-63d43b1ced37 could not be found. Aug 01 14:34:26.054155 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-41adf344-2799-4881-b366-a6c28bf9b58f tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Request method failure captured: Aug 01 14:34:26.054155 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37 HTTP/1.1 Aug 01 14:34:26.054155 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:34:26.054155 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:34:26.054155 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:34:26.054155 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 0 Aug 01 14:34:26.054155 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:34:26.054155 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:34:26.054155 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:34:26.054155 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:34:26.054155 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-LfRmx8f2rN3g_ovRrxbb2lopd0_OZEMNfRL90IttDnr3EeG6rXqYZXuQY7cKcG0JZ9f5tz9EPxGSf3VHC_YPM3ZtfQlzh4g71cOhNH4rHxlpD5LC2A5orXWMD6V-pJ4rV2P1grfTqjxmX7Ynj3hW65Q9kHcjgdGxM7oGexZxqG13g Aug 01 14:34:26.054155 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:34:26.054155 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:34:26.054155 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:34:26.054155 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:34:26.054155 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:34:26.054155 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:34:26.054155 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: 47e500c5985743a2a5abfb99c0f42ab7 Aug 01 14:34:26.054155 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-TestVolumeBootPattern-1884404681 Aug 01 14:34:26.054155 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:34:26.054155 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:34:26.056602 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/47e500c5985743a2a5abfb99c0f42ab7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/47e500c5985743a2a5abfb99c0f42ab7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/47e500c5985743a2a5abfb99c0f42ab7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_47e500c5985743a2a5abfb99c0f42ab7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:34:26.056602 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-TestVolumeBootPattern-1884404681 Aug 01 14:34:26.056602 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 47e500c5985743a2a5abfb99c0f42ab7 Aug 01 14:34:26.056602 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-TestVolumeBootPattern-1884404681 Aug 01 14:34:26.056602 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-TestVolumeBootPattern-1884404681-project Aug 01 14:34:26.056602 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:34:26.056602 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:34:26.056602 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: 540bec8413b144889a07e9d9458b298e Aug 01 14:34:26.056602 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-TestVolumeBootPattern-1884404681-project Aug 01 14:34:26.056602 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: > Aug 01 14:34:26.056602 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Instance 7e66cde1-dc44-443e-9a06-63d43b1ced37 could not be found. Aug 01 14:34:26.056602 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'id': '7e66cde1-dc44-443e-9a06-63d43b1ced37'} Aug 01 14:34:26.057596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:34:26.057596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:34:26.057596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:34:26.057596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:34:26.057596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:34:26.057596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:34:26.057596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:34:26.057596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:34:26.057596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:34:26.057596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:34:26.057596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e66cde1-dc44-443e-9a06-63d43b1ced37 could not be found. Aug 01 14:34:26.057596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:34:26.057596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:34:26.057596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:34:26.057596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:34:26.057596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:34:26.057596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:34:26.057596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:34:26.057596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:34:26.057596 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:34:26.059392 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:34:26.059392 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:34:26.059392 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:34:26.059392 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:34:26.059392 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:34:26.059392 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:34:26.059392 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:34:26.059392 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e66cde1-dc44-443e-9a06-63d43b1ced37 could not be found. Aug 01 14:34:26.059392 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:34:26.059392 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:34:26.059392 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:34:26.059392 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:34:26.059392 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:34:26.059392 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:34:26.059392 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:34:26.059392 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:34:26.059392 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e66cde1-dc44-443e-9a06-63d43b1ced37 could not be found. Aug 01 14:34:26.059392 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:34:26.060868 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-41adf344-2799-4881-b366-a6c28bf9b58f tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Returning 404 to user: Instance 7e66cde1-dc44-443e-9a06-63d43b1ced37 could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:34:26.060868 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-41adf344-2799-4881-b366-a6c28bf9b58f tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37" status: 404 len: 111 microversion: 2.1 time: 0.031809 Aug 01 14:34:26.060868 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 596/1204] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:34:26 2022] GET /compute/v2.1/servers/7e66cde1-dc44-443e-9a06-63d43b1ced37 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:34:29.159629 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-e279a465-ac01-4534-84cf-71e72e39ebe3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:34:29.160296 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e279a465-ac01-4534-84cf-71e72e39ebe3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 24df2492-1b6b-4650-a0d1-1015b1dbe6b3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:34:29.161680 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-5f101d4a-6f8c-4671-bdf5-15f7f3d52056 req-4a8ab7ea-587a-420b-be9c-c53a11b3a6c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24df2492-1b6b-4650-a0d1-1015b1dbe6b3", "tag": "05d47566-3728-458d-8ceb-0d05488c35f6"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:34:29.167425 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e279a465-ac01-4534-84cf-71e72e39ebe3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:29.168240 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e279a465-ac01-4534-84cf-71e72e39ebe3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:29.169146 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e279a465-ac01-4534-84cf-71e72e39ebe3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:29.169791 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-e279a465-ac01-4534-84cf-71e72e39ebe3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:29.171703 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-5f101d4a-6f8c-4671-bdf5-15f7f3d52056 req-4a8ab7ea-587a-420b-be9c-c53a11b3a6c4 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:29.172144 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-5f101d4a-6f8c-4671-bdf5-15f7f3d52056 req-4a8ab7ea-587a-420b-be9c-c53a11b3a6c4 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:29.184202 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-5f101d4a-6f8c-4671-bdf5-15f7f3d52056 req-4a8ab7ea-587a-420b-be9c-c53a11b3a6c4 service nova] Creating event network-changed:05d47566-3728-458d-8ceb-0d05488c35f6 for instance 24df2492-1b6b-4650-a0d1-1015b1dbe6b3 on hv-cinder-84599 Aug 01 14:34:29.189351 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-5f101d4a-6f8c-4671-bdf5-15f7f3d52056 req-4a8ab7ea-587a-420b-be9c-c53a11b3a6c4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031272 Aug 01 14:34:29.189957 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 597/1205] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:34:29.200035 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-e279a465-ac01-4534-84cf-71e72e39ebe3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 24df2492-1b6b-4650-a0d1-1015b1dbe6b3] Going to try to terminate instance {{(pid=118132) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:34:29.283197 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-e279a465-ac01-4534-84cf-71e72e39ebe3 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "DELETE /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3" status: 204 len: 0 microversion: 2.1 time: 0.127369 Aug 01 14:34:29.286847 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 609/1206] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Aug 1 14:34:29 2022] DELETE /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:34:29.293176 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0544f5fb-f8ca-4261-80e3-f903efba13a0 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:34:29.293885 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0544f5fb-f8ca-4261-80e3-f903efba13a0 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 24df2492-1b6b-4650-a0d1-1015b1dbe6b3] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:34:29.301679 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0544f5fb-f8ca-4261-80e3-f903efba13a0 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:29.302142 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0544f5fb-f8ca-4261-80e3-f903efba13a0 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:29.303036 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0544f5fb-f8ca-4261-80e3-f903efba13a0 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:29.303375 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0544f5fb-f8ca-4261-80e3-f903efba13a0 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:29.446170 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0544f5fb-f8ca-4261-80e3-f903efba13a0 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:34:29.454215 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0544f5fb-f8ca-4261-80e3-f903efba13a0 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3" status: 200 len: 1575 microversion: 2.1 time: 0.165706 Aug 01 14:34:29.455033 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 598/1207] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:34:29 2022] GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:34:30.476761 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f4a4a7c6-30a3-4dd6-bdd9-21b39b8e66d8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:34:30.477448 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-f4a4a7c6-30a3-4dd6-bdd9-21b39b8e66d8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 24df2492-1b6b-4650-a0d1-1015b1dbe6b3] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:34:30.483883 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f4a4a7c6-30a3-4dd6-bdd9-21b39b8e66d8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:30.484327 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f4a4a7c6-30a3-4dd6-bdd9-21b39b8e66d8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:30.485081 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f4a4a7c6-30a3-4dd6-bdd9-21b39b8e66d8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:30.485513 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-f4a4a7c6-30a3-4dd6-bdd9-21b39b8e66d8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:30.691928 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.policy [None req-f4a4a7c6-30a3-4dd6-bdd9-21b39b8e66d8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:34:30.700144 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f4a4a7c6-30a3-4dd6-bdd9-21b39b8e66d8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3" status: 200 len: 1575 microversion: 2.1 time: 0.227629 Aug 01 14:34:30.700711 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 610/1208] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:34:30 2022] GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3 => generated 1575 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:34:31.722019 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-dee3fd42-028e-44e8-b541-97ceb172161a tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:34:31.723338 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-dee3fd42-028e-44e8-b541-97ceb172161a tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 24df2492-1b6b-4650-a0d1-1015b1dbe6b3] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:34:31.730339 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dee3fd42-028e-44e8-b541-97ceb172161a tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:31.730793 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dee3fd42-028e-44e8-b541-97ceb172161a tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:31.731622 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dee3fd42-028e-44e8-b541-97ceb172161a tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:31.732083 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dee3fd42-028e-44e8-b541-97ceb172161a tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:31.869751 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-dee3fd42-028e-44e8-b541-97ceb172161a tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540bec8413b144889a07e9d9458b298e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e500c5985743a2a5abfb99c0f42ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:34:31.877661 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-dee3fd42-028e-44e8-b541-97ceb172161a tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3" status: 200 len: 1456 microversion: 2.1 time: 0.159758 Aug 01 14:34:31.878249 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 599/1209] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:34:31 2022] GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3 => generated 1456 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:34:31.953952 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [req-62a3f8b7-5d43-4b56-b3fc-1d4658708a08 req-f84f0c8e-4bc1-40c3-9fe9-8730c5c35aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24df2492-1b6b-4650-a0d1-1015b1dbe6b3", "name": "network-vif-deleted", "tag": "05d47566-3728-458d-8ceb-0d05488c35f6"}]} {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:34:31.965136 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-62a3f8b7-5d43-4b56-b3fc-1d4658708a08 req-f84f0c8e-4bc1-40c3-9fe9-8730c5c35aa1 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:31.965572 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [req-62a3f8b7-5d43-4b56-b3fc-1d4658708a08 req-f84f0c8e-4bc1-40c3-9fe9-8730c5c35aa1 service nova] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:31.978310 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.compute.server_external_events [req-62a3f8b7-5d43-4b56-b3fc-1d4658708a08 req-f84f0c8e-4bc1-40c3-9fe9-8730c5c35aa1 service nova] Creating event network-vif-deleted:05d47566-3728-458d-8ceb-0d05488c35f6 for instance 24df2492-1b6b-4650-a0d1-1015b1dbe6b3 on hv-cinder-84599 Aug 01 14:34:31.983335 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [req-62a3f8b7-5d43-4b56-b3fc-1d4658708a08 req-f84f0c8e-4bc1-40c3-9fe9-8730c5c35aa1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033038 Aug 01 14:34:31.983979 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 611/1210] 10.222.0.17 () {64 vars in 1317 bytes} [Mon Aug 1 14:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:34:32.898856 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d8ce9f44-0472-478a-8acc-f70aa536d4b8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:34:32.899669 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d8ce9f44-0472-478a-8acc-f70aa536d4b8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: 24df2492-1b6b-4650-a0d1-1015b1dbe6b3] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:34:32.907362 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d8ce9f44-0472-478a-8acc-f70aa536d4b8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:32.907919 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d8ce9f44-0472-478a-8acc-f70aa536d4b8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:32.908697 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d8ce9f44-0472-478a-8acc-f70aa536d4b8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:32.909131 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d8ce9f44-0472-478a-8acc-f70aa536d4b8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:32.926107 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-d8ce9f44-0472-478a-8acc-f70aa536d4b8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] HTTP exception thrown: Instance 24df2492-1b6b-4650-a0d1-1015b1dbe6b3 could not be found. Aug 01 14:34:32.927727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d8ce9f44-0472-478a-8acc-f70aa536d4b8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Request method failure captured: Aug 01 14:34:32.927727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3 HTTP/1.1 Aug 01 14:34:32.927727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:34:32.927727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:34:32.927727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:34:32.927727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 0 Aug 01 14:34:32.927727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:34:32.927727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:34:32.927727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:34:32.927727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:34:32.927727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-LfRmx8f2rN3g_ovRrxbb2lopd0_OZEMNfRL90IttDnr3EeG6rXqYZXuQY7cKcG0JZ9f5tz9EPxGSf3VHC_YPM3ZtfQlzh4g71cOhNH4rHxlpD5LC2A5orXWMD6V-pJ4rV2P1grfTqjxmX7Ynj3hW65Q9kHcjgdGxM7oGexZxqG13g Aug 01 14:34:32.927727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:34:32.927727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:34:32.927727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:34:32.927727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:34:32.927727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:34:32.927727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:34:32.927727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: 47e500c5985743a2a5abfb99c0f42ab7 Aug 01 14:34:32.927727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-TestVolumeBootPattern-1884404681 Aug 01 14:34:32.927727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:34:32.927727 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:34:32.929517 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/47e500c5985743a2a5abfb99c0f42ab7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/47e500c5985743a2a5abfb99c0f42ab7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/47e500c5985743a2a5abfb99c0f42ab7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_47e500c5985743a2a5abfb99c0f42ab7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:34:32.929517 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-TestVolumeBootPattern-1884404681 Aug 01 14:34:32.929517 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 47e500c5985743a2a5abfb99c0f42ab7 Aug 01 14:34:32.929517 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-TestVolumeBootPattern-1884404681 Aug 01 14:34:32.929517 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-TestVolumeBootPattern-1884404681-project Aug 01 14:34:32.929517 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:34:32.929517 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:34:32.929517 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: 540bec8413b144889a07e9d9458b298e Aug 01 14:34:32.929517 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-TestVolumeBootPattern-1884404681-project Aug 01 14:34:32.929517 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: > Aug 01 14:34:32.929517 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Instance 24df2492-1b6b-4650-a0d1-1015b1dbe6b3 could not be found. Aug 01 14:34:32.929517 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'id': '24df2492-1b6b-4650-a0d1-1015b1dbe6b3'} Aug 01 14:34:32.930495 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:34:32.930495 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:34:32.930495 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:34:32.930495 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:34:32.930495 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:34:32.930495 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:34:32.930495 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:34:32.930495 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:34:32.930495 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:34:32.930495 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:34:32.930495 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24df2492-1b6b-4650-a0d1-1015b1dbe6b3 could not be found. Aug 01 14:34:32.930495 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:34:32.930495 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:34:32.930495 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:34:32.930495 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:34:32.930495 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:34:32.930495 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:34:32.930495 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:34:32.930495 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:34:32.930495 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:34:32.932092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:34:32.932092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:34:32.932092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:34:32.932092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:34:32.932092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:34:32.932092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:34:32.932092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:34:32.932092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24df2492-1b6b-4650-a0d1-1015b1dbe6b3 could not be found. Aug 01 14:34:32.932092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:34:32.932092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:34:32.932092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:34:32.932092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:34:32.932092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:34:32.932092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:34:32.932092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:34:32.932092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:34:32.932092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24df2492-1b6b-4650-a0d1-1015b1dbe6b3 could not be found. Aug 01 14:34:32.932092 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:34:32.933306 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d8ce9f44-0472-478a-8acc-f70aa536d4b8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Returning 404 to user: Instance 24df2492-1b6b-4650-a0d1-1015b1dbe6b3 could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:34:32.933306 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d8ce9f44-0472-478a-8acc-f70aa536d4b8 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3" status: 404 len: 111 microversion: 2.1 time: 0.034725 Aug 01 14:34:32.933306 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 600/1211] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:34:32 2022] GET /compute/v2.1/servers/24df2492-1b6b-4650-a0d1-1015b1dbe6b3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:34:33.400302 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b48530a6-d33c-407f-bcc7-3a2f9d525f24 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:34:33.400877 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.compute.api [None req-b48530a6-d33c-407f-bcc7-3a2f9d525f24 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: fb882cc8-dad4-4898-9d57-ba546c8b1068] Fetching instance by UUID {{(pid=118132) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:34:33.407276 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b48530a6-d33c-407f-bcc7-3a2f9d525f24 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:33.407753 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b48530a6-d33c-407f-bcc7-3a2f9d525f24 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:33.408521 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b48530a6-d33c-407f-bcc7-3a2f9d525f24 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:33.408953 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG oslo_concurrency.lockutils [None req-b48530a6-d33c-407f-bcc7-3a2f9d525f24 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:33.425346 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.wsgi [None req-b48530a6-d33c-407f-bcc7-3a2f9d525f24 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] HTTP exception thrown: Instance fb882cc8-dad4-4898-9d57-ba546c8b1068 could not be found. Aug 01 14:34:33.427780 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b48530a6-d33c-407f-bcc7-3a2f9d525f24 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Request method failure captured: Aug 01 14:34:33.427780 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: request: DELETE /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068 HTTP/1.1 Aug 01 14:34:33.427780 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept: application/json Aug 01 14:34:33.427780 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Accept-Encoding: identity Aug 01 14:34:33.427780 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Connection: close Aug 01 14:34:33.427780 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Length: 0 Aug 01 14:34:33.427780 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Content-Type: application/json Aug 01 14:34:33.427780 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Host: 10.222.0.17 Aug 01 14:34:33.427780 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Openstack-System-Scope: None Aug 01 14:34:33.427780 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: User-Agent: python-urllib3/1.26.10 Aug 01 14:34:33.427780 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Auth-Token: gAAAAABi5-LfRmx8f2rN3g_ovRrxbb2lopd0_OZEMNfRL90IttDnr3EeG6rXqYZXuQY7cKcG0JZ9f5tz9EPxGSf3VHC_YPM3ZtfQlzh4g71cOhNH4rHxlpD5LC2A5orXWMD6V-pJ4rV2P1grfTqjxmX7Ynj3hW65Q9kHcjgdGxM7oGexZxqG13g Aug 01 14:34:33.427780 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Id: None Aug 01 14:34:33.427780 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Domain-Name: None Aug 01 14:34:33.427780 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Identity-Status: Confirmed Aug 01 14:34:33.427780 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Is-Admin-Project: True Aug 01 14:34:33.427780 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Id: default Aug 01 14:34:33.427780 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Domain-Name: Default Aug 01 14:34:33.427780 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Id: 47e500c5985743a2a5abfb99c0f42ab7 Aug 01 14:34:33.427780 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Project-Name: tempest-TestVolumeBootPattern-1884404681 Aug 01 14:34:33.427780 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Role: reader,member Aug 01 14:34:33.427780 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Roles: reader,member Aug 01 14:34:33.429521 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/47e500c5985743a2a5abfb99c0f42ab7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/47e500c5985743a2a5abfb99c0f42ab7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/47e500c5985743a2a5abfb99c0f42ab7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_47e500c5985743a2a5abfb99c0f42ab7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:34:33.429521 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant: tempest-TestVolumeBootPattern-1884404681 Aug 01 14:34:33.429521 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Id: 47e500c5985743a2a5abfb99c0f42ab7 Aug 01 14:34:33.429521 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-Tenant-Name: tempest-TestVolumeBootPattern-1884404681 Aug 01 14:34:33.429521 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User: tempest-TestVolumeBootPattern-1884404681-project Aug 01 14:34:33.429521 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Id: default Aug 01 14:34:33.429521 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Domain-Name: Default Aug 01 14:34:33.429521 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Id: 540bec8413b144889a07e9d9458b298e Aug 01 14:34:33.429521 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: X-User-Name: tempest-TestVolumeBootPattern-1884404681-project Aug 01 14:34:33.429521 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: method: > Aug 01 14:34:33.429521 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: exception: Instance fb882cc8-dad4-4898-9d57-ba546c8b1068 could not be found. Aug 01 14:34:33.429521 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: action_args: {'id': 'fb882cc8-dad4-4898-9d57-ba546c8b1068'} Aug 01 14:34:33.430438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:34:33.430438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:34:33.430438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:34:33.430438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:34:33.430438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:34:33.430438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:34:33.430438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:34:33.430438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:34:33.430438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:34:33.430438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:34:33.430438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb882cc8-dad4-4898-9d57-ba546c8b1068 could not be found. Aug 01 14:34:33.430438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:34:33.430438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:34:33.430438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:34:33.430438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:34:33.430438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:34:33.430438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:34:33.430438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:34:33.430438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:34:33.430438 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:34:33.432135 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:34:33.432135 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:34:33.432135 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:34:33.432135 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:34:33.432135 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:34:33.432135 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:34:33.432135 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:34:33.432135 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:34:33.432135 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:34:33.432135 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb882cc8-dad4-4898-9d57-ba546c8b1068 could not be found. Aug 01 14:34:33.432135 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:34:33.432135 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:34:33.432135 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:34:33.432135 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:34:33.432135 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:34:33.432135 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:34:33.432135 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:34:33.432135 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:34:33.432135 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb882cc8-dad4-4898-9d57-ba546c8b1068 could not be found. Aug 01 14:34:33.432135 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: ERROR nova.api.openstack.wsgi Aug 01 14:34:33.433772 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-b48530a6-d33c-407f-bcc7-3a2f9d525f24 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Returning 404 to user: Instance fb882cc8-dad4-4898-9d57-ba546c8b1068 could not be found. {{(pid=118132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:34:33.433772 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-b48530a6-d33c-407f-bcc7-3a2f9d525f24 tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068" status: 404 len: 111 microversion: 2.1 time: 0.034276 Aug 01 14:34:33.433772 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 612/1212] 10.222.0.17 () {58 vars in 1239 bytes} [Mon Aug 1 14:34:33 2022] DELETE /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:34:33.438096 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c3087cfe-cbe5-43f4-8678-18982c05c73f tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:34:33.438728 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c3087cfe-cbe5-43f4-8678-18982c05c73f tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] [instance: fb882cc8-dad4-4898-9d57-ba546c8b1068] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:34:33.446158 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c3087cfe-cbe5-43f4-8678-18982c05c73f tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:33.446698 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c3087cfe-cbe5-43f4-8678-18982c05c73f tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:33.447523 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c3087cfe-cbe5-43f4-8678-18982c05c73f tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:33.447993 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c3087cfe-cbe5-43f4-8678-18982c05c73f tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Lock "9805e85f-ba25-403f-8805-6e956776eddb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:33.464703 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-c3087cfe-cbe5-43f4-8678-18982c05c73f tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] HTTP exception thrown: Instance fb882cc8-dad4-4898-9d57-ba546c8b1068 could not be found. Aug 01 14:34:33.466229 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c3087cfe-cbe5-43f4-8678-18982c05c73f tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Request method failure captured: Aug 01 14:34:33.466229 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068 HTTP/1.1 Aug 01 14:34:33.466229 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept: application/json Aug 01 14:34:33.466229 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Aug 01 14:34:33.466229 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Connection: close Aug 01 14:34:33.466229 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Length: 0 Aug 01 14:34:33.466229 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Content-Type: application/json Aug 01 14:34:33.466229 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Host: 10.222.0.17 Aug 01 14:34:33.466229 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Aug 01 14:34:33.466229 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.10 Aug 01 14:34:33.466229 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABi5-LfRmx8f2rN3g_ovRrxbb2lopd0_OZEMNfRL90IttDnr3EeG6rXqYZXuQY7cKcG0JZ9f5tz9EPxGSf3VHC_YPM3ZtfQlzh4g71cOhNH4rHxlpD5LC2A5orXWMD6V-pJ4rV2P1grfTqjxmX7Ynj3hW65Q9kHcjgdGxM7oGexZxqG13g Aug 01 14:34:33.466229 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Aug 01 14:34:33.466229 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Aug 01 14:34:33.466229 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Aug 01 14:34:33.466229 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Aug 01 14:34:33.466229 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Aug 01 14:34:33.466229 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Aug 01 14:34:33.466229 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Id: 47e500c5985743a2a5abfb99c0f42ab7 Aug 01 14:34:33.466229 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-TestVolumeBootPattern-1884404681 Aug 01 14:34:33.466229 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Role: reader,member Aug 01 14:34:33.466229 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Roles: reader,member Aug 01 14:34:33.467959 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/47e500c5985743a2a5abfb99c0f42ab7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/47e500c5985743a2a5abfb99c0f42ab7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/47e500c5985743a2a5abfb99c0f42ab7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_47e500c5985743a2a5abfb99c0f42ab7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 01 14:34:33.467959 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-TestVolumeBootPattern-1884404681 Aug 01 14:34:33.467959 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 47e500c5985743a2a5abfb99c0f42ab7 Aug 01 14:34:33.467959 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-TestVolumeBootPattern-1884404681 Aug 01 14:34:33.467959 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User: tempest-TestVolumeBootPattern-1884404681-project Aug 01 14:34:33.467959 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Aug 01 14:34:33.467959 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Aug 01 14:34:33.467959 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Id: 540bec8413b144889a07e9d9458b298e Aug 01 14:34:33.467959 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-TestVolumeBootPattern-1884404681-project Aug 01 14:34:33.467959 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: method: > Aug 01 14:34:33.467959 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: exception: Instance fb882cc8-dad4-4898-9d57-ba546c8b1068 could not be found. Aug 01 14:34:33.467959 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: action_args: {'id': 'fb882cc8-dad4-4898-9d57-ba546c8b1068'} Aug 01 14:34:33.469109 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:34:33.469109 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:34:33.469109 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:34:33.469109 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:34:33.469109 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:34:33.469109 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:34:33.469109 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:34:33.469109 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:34:33.469109 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:34:33.469109 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:34:33.469109 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb882cc8-dad4-4898-9d57-ba546c8b1068 could not be found. Aug 01 14:34:33.469109 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:34:33.469109 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:34:33.469109 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:34:33.469109 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:34:33.469109 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:34:33.469109 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:34:33.469109 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:34:33.469109 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:34:33.469109 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:34:33.470661 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:34:33.470661 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:34:33.470661 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:34:33.470661 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:34:33.470661 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:34:33.470661 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:34:33.470661 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:34:33.470661 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb882cc8-dad4-4898-9d57-ba546c8b1068 could not be found. Aug 01 14:34:33.470661 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:34:33.470661 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:34:33.470661 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:34:33.470661 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:34:33.470661 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:34:33.470661 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:34:33.470661 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:34:33.470661 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:34:33.470661 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb882cc8-dad4-4898-9d57-ba546c8b1068 could not be found. Aug 01 14:34:33.470661 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Aug 01 14:34:33.472183 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c3087cfe-cbe5-43f4-8678-18982c05c73f tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Returning 404 to user: Instance fb882cc8-dad4-4898-9d57-ba546c8b1068 could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:34:33.472183 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c3087cfe-cbe5-43f4-8678-18982c05c73f tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068" status: 404 len: 111 microversion: 2.1 time: 0.033488 Aug 01 14:34:33.472183 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 601/1213] 10.222.0.17 () {58 vars in 1236 bytes} [Mon Aug 1 14:34:33 2022] GET /compute/v2.1/servers/fb882cc8-dad4-4898-9d57-ba546c8b1068 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:34:34.802198 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: DEBUG nova.api.openstack.wsgi [None req-f498b63b-76fa-4d28-b1b3-73f4867f4abe tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] Calling method '.version_select at 0x7f6184db9160>' {{(pid=118132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:34:34.822421 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO nova.api.openstack.requestlog [None req-f498b63b-76fa-4d28-b1b3-73f4867f4abe tempest-TestVolumeBootPattern-1884404681 tempest-TestVolumeBootPattern-1884404681-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-89656764" status: 202 len: 0 microversion: 2.1 time: 0.024040 Aug 01 14:34:34.823001 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: [pid: 118132|app: 0|req: 613/1214] 10.222.0.17 () {58 vars in 1257 bytes} [Mon Aug 1 14:34:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-89656764 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 14:35:24.554170 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:35:24.555619 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Mon Aug 1 14:35:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:35:48.845293 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:35:48.846136 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Mon Aug 1 14:35:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:37:10.872549 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:37:10.873166 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Mon Aug 1 14:37:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:37:18.273232 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:37:18.274023 dv-cinder-845990-5-iscsi devstack@n-api.service[118132]: Mon Aug 1 14:37:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:38:44.564841 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:38:44.565480 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Mon Aug 1 14:38:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:39:08.853949 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:39:08.854566 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Mon Aug 1 14:39:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:39:33.399226 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:39:33.399936 dv-cinder-845990-5-iscsi devstack@n-api.service[118133]: Mon Aug 1 14:39:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!